Shau Kei Wan is home to the Museum of Coastal Defence in the converted Lei Yue Mun Fort. The museum is in the redoubt, a high area of land overlooking the narrowest point of the harbor; you take an elevator and cross an aerial walkway to reach it. As well as the fascinating historical displays indoors, there's a historical trail complete with tunnels, cannons, and observation posts.
Visit the Travel Talk forums for help on planning your trip