i don't think we should be too concerned about killing yourself - after all that is not too common!
Every day SA is much more about avoiding infringements (which happen all the time), irritating other pilots because of unintentional poor airmanship, and scaring yourself a bit because you get into situations you wished you had not.
In reality these are some the everyday consequences of a loss of SA.