Nigel, I am sorry to say it but Helen's earlier assessment seems to be true if you believe what you are posting about rules.
Just because a rule doesn't suit you or what you perceive your capabilities to be does not give you carte blanche to ignore it.
The graveyards are full of pilots who thought they knew better than the legislators and then discovered the rules were there for thier protection, mainly from themselves.
It is strange that you acknowledge your limitations with regard to instrument flight but not low level/poor weather flight.
If your are on a VFR transit and your choice is to descend below 500' or turn back then you should make the turn back decision then, not 5 miles later when you are now at 100' having compromised your safety and that of your passengers.
If you want the thrill of low flying then do it over a suitable area on a good day - don't wait until you are forced into it by weather.