If you meant literally this, then I would agree. I took your comment to be in the context of the debate. In other words the pilot was an instrument rated pilot but technically restricted to VFR because for example he held an FAA IR but the aircraft had a G on the side.
The thing is that any pilot who can't legally fly under IFR for whatever reason, is a VFR only pilot at that time, whether they like it or not.
A pilot should always have a plan B for when the weather doesn't work out as expected.
If your plan B is to do something that is illegal, then you shouldn't be surprised if the authorities become interested in your decision making.
Doing illegal things should be well down the list of options in routine flight planning!