24 isn't too late. If it's your dream? Make it happen.
If I was 24, and had it to do over again, and knew what I knew now about aviation, I'd have pursued my Law Degree like I should have in the first place.
All I could add, is, make sure this is what you want to do.
Willie
