Agree with you on the really bad conditions.  I do as best I can to avoid those.

What I am talking about is like near gale force wind and rain or sleet.  Wave height up to 6m in open water, less if fetch is short.  Temperature around freezing point or slightly above.   In my experience, windows with wipers are better than goggles.  And rotating windows are probably even better (never had that on my boats, but fishermen use them).

Various electronic navigating aids are all great unless they fail, but in addition I want a good lookout anyway. 

And I second that autopilot, and certainly want one on my boat,  but I am reluctant to trust it as my primary steering device.  I have some experience with autopilots, both hydraulic and tiller pilots.  When conditions get bad, they sometimes are not able to steer the boat as a helmsman, especially downwind.  Also, they (especially tiller pilots) are susceptible to water ingress, actuator/pump failure or power failure.  That does not happen when conditions are good - it only happens when you really need them.