If the controller agreed it was the thing to do, presumably he saw no problem on his screen at the time and I doubt if you've got 'owt to worry about, as the situation wouldn't have been reported.
If it goes further however, then thank goodness you're a member of AOPA (well you are aren't you?), 'cos you'll likely have Tudor Owen on your side.
If you're not a member of AOPA, then it's too late now.
'Nuff said?
Safe flying
Cusco