It's not a silly argument. The call implies that the other guy hasn't seen you, isn't following procedures or doesn't know what he's doing. You're questioning his airmanship.
It also suggests that you are uncertain, nervous, inexperienced or reliant on radio and ATC.
Bear in mind that this is the impression that others who may be listening but not watching the situation may get. 'The other guy' then gets greeted on the ground with an 'oh, you're the guy who tried to cut up/didn't see/doesn't comply....' type of comment.
The irritation(distraction) of the above scenario, whether the former or latter case, doesn't belong in the cockpit either CRM-wise.