I'm also a New Englander, though one from the south in western Mass, who also smokes outside only. Although our winters aren't quite as severe as Maine's, they're fine competitors. Anyway, I usually limit my lengthy smokes of an hour or more to when the temps are in the 20's. I set up a nice space in my tool shed, and if it's not windy and the sun is out, one of the doors will be open.
This morning is in the single digits after yesterday's snowstorm but it's sunny and should creep up into the teens this afternoon. I think I'll be tempted to fill a Dagner poker cob with some VA #22 I've just recently started smoking and park myself somewhere out in that sunshine.
Not as hardcore as Sir Banjo, I know, but I think I have an inkling of his piping rituals. And Mr monbla256, while I do have much respect for you, I can assure you that smoking outside whatever the temperature, is definitely not stupid.