I have a GPS and I use it.
It is quite a new one, got it after christmas in the sales.
A garmin legend.
Officially you are meant to navigate by reference to the ground as a VFR pilot. Plus, I don't really trust the GPS.
several times I have grabbed it only to see the words, "requires clear view of the sky" despite the fact it had been sitting merrily on the dash in full clear view of the sky for ages.
Maybe as I get used to it and feel more comfortable with it I will use it more.
However, do remember, you are not really meant to be relying on your GPS you know!