It's amazing how one man's remote possibility seems to be another's day to day life. Total loss of autopilots, and decompression are both in my recent resume.
Nevertheless, I'm not a fan of people hand flying large jets, willy nilly. That's what the sims are for. Perhaps the real problem is that the sim exercises are a case of them vs us, and most of us want to get out of the box as soon as we've picked up enough ticks to do so.