avionimc is spot-on.
If you're not a US citizen it might take the FSDO two weeks to evaluate your security threat level so you can visit them (even if their building is under the downwind-to-base turn of your local airport at which you fly), although when I ran into this issue a convenient workaround was to have the meeting in the lobby which requires no security clearance of any kind.