Yes, you have a valid point.
At age 38, should you delay gaining hours on type, how can you possibly hope to attract employment in the future?
Armed with 500 + hours on type, now aged 40, as the upturn happens you are 'back on profile' as opposed to sending countless applications with a PA28 rating and a few circuits to boast.
The A320 rating is a much 'sought after dignity'. I reckon you have no choice but to do it. If you don't P2F you may as well use your licence as a beer mat. Okay its going to cost some money but, aged 38, how long can you put your career on hold without making yourself unemployable?
Go for it before it's too late.. All that work will have been for nothing!