32 F is freezing BTW. I remind my wife of this fact pretty much daily.
I'll drive into the 40s. I also have heated seats and I drive with the tonneau over the passenger area. This helps with the wind. I also made a prototype tonneau cover that helps even more. This with Danny's heater, and I'd drive anytime.
The final version might have a zippered seam so one could use the door for exiting the car.