At least with a single you know you're always going down when the engine quits. With a light twin, the possibility of remaining in the air on one is definitely a double-edged sword. And, of course, you have twice the chance of an engine failure.
We had a good thread on this a while back in which I vented similar prejudices. (Jeez, I've turned into a pprune old bore.)
QDM