Public Places
You may take photos in most public spaces without restriction. Where restrictions do occur, they usually fall into the category of "common sense" restrictions, such as in elementary schools, police buildings and prisons, and in courtrooms. There are also special rules for government legislative buildings. The constitution actually gives congress the right to control its buildings, so this is not even subject to judicial oversight.
Public Places - No Restrictions:
-street
-sidewalk
-airport (except for off limit areas such as runways)
-beach, park, zoo
-train, bus station
Public Schools:
Generally, you may photograph in pre-school through high school only with the school administrator's permission. Since they have the right to restrict access to the campus, they effectively have the right to restrict access to photographers. Note: parents do not have the right keep their children from being photographed on school property.
You may take photos without restriction on public university property, although you may not photograph in classrooms during instruction time without the instructor's permission. Dorm areas are also considered off limits except with prior permission.
Public Places - Restricted:
-Hospitals
-Prisons and jails
-Military Bases
-NSA, CIA, SEC, NRC, Library of Congress
-Lawmaking Venues - Congress and it's offices
-Tribal Lands
-Courtroom
Private Property
Generally, you may photograph onto private property without permission if it is in "public view." You may stand on the sidewalk and photograph someone mowing their lawn or sitting on the porch, even inside the window. However, you may not use extraordinary techniques, such as long telephoto lenses.
You may not step onto other people's property without their permission. This is trespassing and is illegal. The law is murky about photographing in privately owned but public spaces, such as shopping malls and restaurants. Your best bet would be to follow the rules set down by the owner.
You may publish any photos that you have already taken. The owner can't demand your film or memory card, and may be guilty of battery if he touches you or the camera. He can, however, bar you from taking further photos.
Police Authority.
The courts have ruled both ways on whether the police may invite photographers onto public property, but the U.S. Supreme court has ruled that this violates the 4th amendment right against unreasonable search and seizure.
The police often will forbid you from photographing where you have a clear right to photograph. You should listen and obey them unless you are prepared to go to jail and pay the costs of the court case to stand up for your rights. The police do have the right to control photography if it legitimately interferes with an active investigation.
http://www.lbpost.com/life/12188-police-chief-confirms-detaining-photographers-within-departmental-policy#.UMCyGJPjlgZ
http://www.pixiq.com/article/long-beach-police-trained-to-detain-photographers
The Patriot Act and Homeland Security Act does NOT forbid you from photographing in public places or around public buildings, such as bridges, harbors and industrial facilities. Doing so, however, may invite federal agents to your house for questioning.