As a regular flier from a private site, I am perfectly happy, knowing the elevation of the strip, to wind that altitude on the altimeter, thus providing my own "derived" local QNH. I don't think there is any doubt on this forum that, for any foray under CAS where the base is expressed as an altitude, an appropriate aerodrome QNH should be used.
Jumbo Driver, agree totally.
Another reason against QFE is potential bust of the bottom of controlled airspace if you depart on QFE and then omit to set QNH on/after departure especially where the departure elevation is relatively high. An example is Biggin Hill below the London TMA which is circa 600 ft amsl and there has been at least one documented case of this happening.