Unless you want the IFR capability find a Permit aircraft, a friendly engineer and a small grass strip.
Not sure I'd agree with you completely. I'd rather go with the the aircraft I want than drive one that didn't fit my 'mission profile'.
The Permit fleet divides into older types and home-builds (generally affordable, but limited) and the newer generation (big money and better performance). The majority are still 2-seaters.
Apart from the hassle factor of EASA Part M, I am generally happy to stay on CofA. I note that Permit owners are not immune from the hassle factor themselves, so you make the choice that suits you