I have to say that, five hours to get to Statue of Liberty - that is train to the tip of Manhattan, then a ferry, then the visit, then return journey? That will not fit and the possibilities for not getting back are far too many.
If you can find diversions within the airport, then you can complete your journey.