In response to a previous poster I don't think ATC keeps a "black book" of unsavoury characters. However what does cheese them off somewhat is prats who don't have a clue what they are doing and fanny about in the busy CAS, e.g. folks who don't have a clue about CAS transit/local procedures, bad RT, people who request transits that take them through ILSs, people who don't follow VRPs/entry-exit lanes etc.
And of course, in contrast, every place also has a few regulars who do know what they're doing and where they're doing it, who are on the ball with their R/T and situational awareness, and who can be trusted to respond to the circumstances and revised clearances very well. They typically can ask for, and get, anything they want with regards to VFR CAS transits/operations. (Except for the bleeding obvious like orbiting in the ILS area, but that's something they don't even request.)
I fly out of a relatively busy controlled airport and local pilots here recognise the controllers by their voices and R/T habits, and vice versa. So if there is a black book somewhere, it's not based on callsigns but rather on other clues like R/T. After all, there may be a very experienced instructor commanding an aircraft, and one hour later an early solo student.