You can fly with just a compass, in smooth conditions, to keep the wings level.
But if you get into anything remotely resembling a "bank angle" then you will not recover.
Also, for some reason, most planes are more roll-stable in a descent, so getting down is less work.
It is somewhat easier to do this stunt with a gyro compass (a DI) because it doesn't wobble about so much.