Why has the job been made more difficult & perceived to be more dangerous?
I think you answered your own question. It's just a perception. The reality is that modern commercial aviation is safer than ever:
http://www.airbus.com/company/aircra...ocID%5D=108528 [PDF]
I'm sure there is always room for improvement, but these statistics are far more compelling than the rose-tinted anecdotes of retired aviators from yesteryear. And what this data fails to capture is that a huge chunk of the growth in flights has happened in developing countries. The fact that safety has nevertheless improved so much is a staggeringly impressive achievement.