There may be some units where the desk furniture would make it difficult for you to work without straining something or ending up with a bad back, but I don't see that as an excuse for not hiring you in the first place. Some units will be more ideal than others for someone of your stature and this could be taken in to account surely.
I would certainly fight the decision all the way.
Good luck.