I liked Union Square, we did not not shop much at all. We felt it was a good central place to Bart, the trolleys and the buses. I also thought North Beach looked charming and family friendly.

Some specific mention should be made of parking prices: our hotel chaged $40 a day.

Just to be clear because these days some people do seem to quickly take offense if someone disagrees. I was not implying that Gekko was wrong, only that I believe there is a difference between needing a car in SF --as one really does in LA because it is so spread out, and whether having a car is more convenient if you are willing to pay for parking.

If you don't shop then the closest points of interest to Union Sq include the SF Museum of Modern Art and Chinatown.

I like the central location of Union Square myself, although I'm a sucker for the views from Nob Hill too. I do NOT go up to SF to shop (and why would I?!), so I pretty much ignore that aspect of Union Square. But the proximity to the big BART station at Powell and Market, the access to cable car lines and cabs (everywhere), having Chinatown within walking distance, etc.-- that keeps me there.

I would entertain staying in other areas, sure. But I don't rule out Union Square.