Think of the implications if such a rule did exist!
How far away could a cloud be and still be relevant to this calculation? People with better eyesight who were able to spot clouds in the far distance might be forced to fly along at treetop height while the more myopic soared aloft entirely untroubled!
I think we should keep this idea under wraps though, in case the likes of EASA take it up.
Joking aside, when I'm flying a non-IMC-capable aircraft I tend to scale up cloud forecasts to avoid being caught out, so for example I assume that 'broken' will actually be a solid overcast etc.