Is this behaviour something that most of us wouldn't indulge in with non-pilots? Probably. Is it incredibly dangerous compared with everything else associated with light aviation or life in general? Probably not.
I'd be much more concerned with a report detailing a habit of low, slow and shallow final turns than a seat swap in mid-air, IMHO.