If you want a small hotel in a quiet location, practically opposite the Louvre (1st arrondissement), you could try Hôtel Louvre Bons Enfants Louvrehttp://www.hotellouvrebonsenfants.com. At night, you can stroll through the Louvre, past the Pyramids and onto the Passerelle des Arts with its lovelocks. Or you can sit in the Tuileries and watch the sun set over the Louvre or the Eiffel Tower. Just a short walk (or take the river boat) and you're at the Orsay Museum. This is where I live so you might like to check my blog for places to eat and details on the area (powerwalking series), starting with http://www.aussieinfrance.com/2011/10/padlocks-on-the-pont-des-arts. Bus 72 opposite the Louvre will take you on a lovely ride down to the Eiffel Tower http://www.aussieinfrance.com/2012/02/bus-n-72-to-the-eiffel-tower. Have a wonderful romantic honeymoon!

I love the Millesime as it's on one of my favorite streets. You might also look at the Britainnique . Firned sof mine lone this place and a great location

http://www.hotel-britannique.com/index-2.html

Thanks AussieFrance and avalon. I will check out the hotels you suggested. I forgot to add that I wish the rooms to be larger in size, I know that hotel rooms in Paris are known for being notoriously small.

The Millesime is in a great area and meets all of your stated needs. Not too far away and also in the 6th Arrondisement is our favorite hotel in Paris - the Hotel des Stes Peres. It has charm and a really helpful and welcoming staff.