Only you could make this decision. As many of us have found out it is a trap that is very easy to fall into. The first rule must be never to allow yourself to get into a situation from which there is no escape route.
Limits are just that. They are not something that has to define a persons operational choices. Indeed the margins allowed for error should be very wide indeed for those without a great deal of experience of operating any where near the legal limits.
weather forecasts are not universally accurate especially as they may apply locally. Airframes and engines are not always reliable. Humans as we know are most definitely not foolproof. Accepting the inherant risks, they still can be minimized by good planning, good judgment and good luck.
If you find yourself in a serious predicament the first priority is to save lives before considering anything else. If you are competent to operate in IMC ( and many have found out to their cost they aren't) then it doesn't matter which rules you break. You can answer to that later. Equally if you break the height rules to maintain VMC that may be the way to survive as a better choice.
Indeed there is no right or wrong answer. Only you can decide on the best course of action given the many variables. The clever aviator applies whatever criteria it takes to avoid finding themselves in these predicaments.