I think the biggest hurdle is the reliability issue.
Many people are not at all interested in aviation, but they might be interested in going somewhere reasonably far away in a short time, (France for lunch etc.) but after the third time of the flight being cancelled due to weather or tech failure they become much less enthusiastic.
My other half hasn't even set eyes on my a/c!