If you're only "pottering" locally for recreation, the weather is good and have plenty of fuel and no real destination, apart from getting home again before dark, I see no issues with that at all.
But I never fly to potter around the skies. Actually going to a particular destination, on a timescale, for a particular purpose, (in typical UK weather) is a very different kettle of fish.