Well, I guess then that you are in the clear, as it were. Sounds like a jolly nice life style actually.
Oh yes, and these days you are allowed to have a residence availablefor your use in the UK without prejudice to your status as a non resident. But I expect that you knew that?