Loads of them do it, and not all them were previous RAF pilots.
I'd say its a great idea - use the 6 years in the RAF to have a great time, learn loads of skills and SAVE cash by living in the mess etc so when you pop out the other end at 30 you have a big pile of cash waiting to cover your flight training costs!
Compared to a job in an office - no contest! Go for it...