Not too old
You are not too old, at 24 your brain is reattaching itself back to your body and reason, logic, common sense and the begining of wisdom are coming alive.
You will obviously only have one passion, flying. Girlfriends are a burden because they will not understand your passion, and they will not want to be second place.
I got married later in life, mid 30's, got a great career flying big jets, making a lot of money. I started when I was 22.
24 is the ideal age, and you may have killed yourself had you started earlier.