MJ,
We used to encourage the GA community to go flying early (7am) on a Sunday morning,and not once did they ever take it up.The ATCOs were there due to the opening hours of the airport and minimum staffing.Our break was a day shift and NO fat in the system.
The answer I got one more than one occasion was that they were recovering from their hangovers the night before.Yet they would complain when messed around at busy times during the week.