Well, I speak for myself, but I dont think of it as being dangerous, and I dont think many other pilots do either.
If something bad happens then you just do your best to fix it up and land safely, if you cant, well then thats life!
Someone I spoke to said he could never be a pilot because of the responsibilty of all those pax. I dont really think of it that way, I look after number one. I figure that in saving my own life each flight the pax will live too!