In my opinion it really is no problem, provided you have a flight school willing to accomodate your hours.
Train at least twice per week and you should be good to go.
I did the IR SE this way without any significant problem.
Or, you could choose a fast school, full time, which will provide your training in two months tops.
I would recommend that option.