Surely bailing out of say a C152/172 would be pretty simple? My boss used to regularly pop the doors in the cruise as an amusing alternative to the rudder and they're much easier to open against the airflow than you'd think. PA28 would be a bit "tricky" but if we all started wearing 'chutes then an after-market door jettison is hardly rocket science.
It's private flying though, the risk is entirely yours to take. There's surely a good bit of 'herd mentality' involved in the decision you make though? How would you react if someone walked out to a C172 at your club wearing full nomex, gloves, helmet and carrying a parachute? Praise them for being so safety conscious?
Survival equipment is for the very, very (very) rare occasions you suddenly find you need it. You may be totally comfortable flying in your normal clothes sans 'chute and it's your risk to own - but if you had an inflight fire or miraculously survived a mid air (and people do, it's just mainly glider pilots you hear from afterwards for some reason 🤔
only to find yourself with half a wing then I suspect your opinion on the issue would change fairly rapidly, albeit briefly...