There are several GA places around the area but wheels are needed. The bus/train system is not as in the UK but you won't have to drive far.
Teterboro comes to mind but is very busy. Long Island has American Flyers at Islip for your IR and there are probably others that are cheaper. There are also several fields on the NJ side.
Not very precise I know, but a start.