If the RA is not for the aircraft you are visual with, then surely you have a TA for both?
That assumes all aircraft have operating transponders, which might not be the case. There are many GA aircraft without transponders, or one might be inop, or a student pilot who accidentally left it at STBY, etc.