I'm looking to do a weekend getaway with my husband in May. Ideally, I'd like to be within 2-3 hours driving time from Manhattan, and in a place with lots of outdoor activities like hiking, biking, rafting, etc. Any suggestions?

For rafting in NY State, the Adironacks, the Catskills or the Hudson Valley.

Escapemaker.com is a website that helps you pick a weekend getaway. By searching for rafting in NY State, I got these options

http://tinyurl.com/76mae

There are also plenty of places in Pa. and one place listed in Kent, Ct.

Without rafting, your options broaden.

Just came across this by accident

http://gorp.away.com/gorp/location/cities/new_york.htm

The Hamptons. Great kayaking in the Sound. Farther east has better hiking.

Litchfield county connecticut.
Pretty little places to stay--check out lake waramug...a popular biking and hiking spot

Thanks everyone -- great tips!

Pike County, Pennsylvania. 2 hours aways. Milford, PA is a nice town, there's rafting along the Delaware, lovely vistas along the river, hiking in the Poconos, a couple of decent restaurants a short drive away in Hawley.