I generally find ATCOs are very keen to get pilots in their office. It helps you understand what they do and generally leads to better co-operation between pilots and controllers.
I usually find non VFR days are better to visit them because they are less busy and those are usually days when you can't fly.