The FBO probably doesnt want to handle you out of hours but is made to by the airport? That means that they will have to pay overtime/stand by allowances to their staff and all that stuff. If they are made to pay this surely it is reasonable to pass it on?
FBO's generally are not huge earners. Focus on the landing fees, thats where the money goes.
