it has happened many times because no matter how much you love hand flying you don't have any experience of it at cruise altitudes which are in RVSM. So if it's done in panic there can be trouble. The aircraft is very sensitive due to less damping. The correction in pitch and roll has to be much smaller scale and one has to remember all that in a hurry. It's much simpler to be conventional than be exceptional.