I take strong exception to your characterisation of auto pilot use as "flick-on flick-off piano playing" You sound typical of someone who has maybe done a fair amount of recreational boating over the years, and has gotten to the stage of thinking they know it all. And has never used an auto pilot. I spent 26 years, continuous, behind the wheels of various fast planing hull commercial fishing boats. Typically leaving long before first light, a long way to travel. In all sorts of conditions. Then a long return trip. Yes, I have seen MISUSE of auto pilots result in death by collision. A number of times. Leaving the wheel with no-one in command at speed is negligence, pure and simple. Someone must always be on look out, first rule of boats, with or without pilot. I insist on having someone behind the wheel at all times even at trolling speed with no-one else about. The person on the wheel has to leave for whatever reason, the next closest person moves behind the wheel. Thems the rules.In fact, you can keep a better lookout on pilot, as you are not glued to the bloody compass. No problems with disorientation in the dark, as well. Fatigue is the killer on long runs, autopilot use reduces fatigue considerably.
You are basing everything on a specific run where it may not need autopilot. I would suggest that it is you who is indulging in desktop theory--I, on the other hand, am talking about a very wide range of scenarios.