I get the heebie-geebies when something lends scale to the height I'm at. I would quite cheerfully go up a 10 metre diving-board and dive off outdoors, but try it indoors, when I realised that I was up close to the ceiling of the swimming pool ...
I used to get exactly the same sensation when flying just underneath a high cloudbase with a clear view down to the ground.