I'm thinking more about areas of the UK in VFR conditions. Try flying in the area of the CPT VOR at 2000' on a 'summer's day' without looking out the window.
Proper knowledge of using GPS means you don't need to be in the vicinity of a choke point like the CPT VOR and thus aids safety.
Proper use of GPS means spending more time looking out 'seeing and avoiding' and less time heads down 'avoiding' CAS or trying to establish position.
All I am getting from the anti brigade are examples of people abusing GPS as Max says.
Any tool is potentially dangerous in the hands of someone who doesn't understand how to use it - try putting a large ferrous object near the whisky compass and see what happens - its been done before.