I've never found that people think flying is a hobby for the wealthy.
I work in education - not particularly well paid - in a very working class area. No-one seems to be surprised that I can afford to fly. They may be surprised that I want to do it or can do it, but that's all.
I live in a fairly well off area and it is just accepted, though seen as a bit of a novelty.
PS slight thread creep - The British Prime Minister is the MP who can 'command a majority in the House of Commons'; he or she, rightly or wrongly, has never been elected as PM.