Portsmouth NH.

Maine, lots of places, except the winters are long and the springs are short.
New Hampshire, ditto and no sales tax.
Vermont, not so much. Weird combination of people with trust funds and potential meth-head types not yet tipping the balance but worrisome.

But what can you do to earn a living? People in demand are doctors, nurses, welders, plumbers, electricians, machinists, mechanics of all kinds: diesel, auto, marine, small engine; mechanics, commercial fishermen. Not in demand: craftspeople who don't have a trust fund, astrologers, crystal therapists, snow plow operators (the locals have that all sewed up), B&B operators.

You should buy a Subaru or 4 wheel drive truck.

What's the old saying? You can never go home again?

What about central Pennsylvania, north of State College?

As Oregon is famous for logging as an industry and the Douglas Fir, among other types of conifers, I would cross Oregon off your list.

And the no meth-head would eliminate about 90% of the small towns.

I was going to recommend southern Vermont as just about exactly what you wanted, but I am woefully ignorant of meth-heads, their culture and geographic concentration.

If you don;t want prolonged heat why do you keep looking at the south? (Any place south of DC the summers are hellish.)

I would suggest New England - but that may be too cold for you.

What's wrong with NY - state that is. Large, gorgeous, hot summers and cold winters - but we do have all four seasons - and you don't need to be near NYC. I mean there are a lot of places near Cornell - or other upstate schools.

If you hate heat stay out of SC. Plus it's very piney.

You do seem to be looking in "all the wrong" places!! As mentioned, central PA near State College or one of the many other college towns in western or Central PA. would fit. And New York state,with also many college towns and lots of forests....

Also try Wisconsin/Minnesota,northern Michigan.

Almost anywhere north of the Mason Dixon line. No fooling. I'm interested in people who take this seriously, and I am also.
and don't go up in eleveations.

Several others have mentioned Central PA. For the best hospital/medical center choose Danville PA for Geisinger.
Are you also allergic to Juniper? There are a few good choices in eastern Oregon that would work.
Since the prevailing wind is from the west, the Oregon coast might work. Try taking a few vacations to cross some places off the list until you find a place that works for you.
I moved from central PA to central Oregon 7 years ago.

Summit, oregon west of Philomath, not far from Corvallis & OSU.