ID passes are to enable you to perform your job. If your job involves wondering over to the tower then fine, but if your job is flying planes then don't be surprised if you get taken in for questioning if security ask you what you are doing wandering around an airport. You are certainly not allowed to use an airside pass when not working.