As the audience at the CAA "safety" seminar will quickly tell you, "you can go anywhere VFR, young man"
(and it's true, technically speaking)
I just wouldn't want to be sitting at 5000ft, somewhere just below Class A, collecting ice, with several hundred nm of +2C water in all directions, when I could be sitting at 12000ft, in sunshine.