As stated, it depends on what your normal is.
I too have never had a problem changing to tower with "XXX Tower, Bigjet 123"
But if your normal is "XXX Tower, Coolpilot 456 checkin' in with you showin' four miles back on ILS 01" then I suppose you'll have to pay attention to "Callsign only" on the handoff or AOI.