Yes, flying is a serious business. It's very easy to mess up something and get into trouble.
I think most pilots realise this and I also think that is a big reason why so many give up. There is the constant worry of ending up in deep s**t, which you just don't have in other walks of life e.g. driving (except, in driving, speed cameras but one can install warning devices for those).