Common sense will tell you that the rule about turning to the right is based on two facts;
1 that this gives you the best visual position on the assumption that you are flying on the left seat of the aircraft.
2. it is better for two aircraft in this situation to move in the same direction relative to their individual line of flight.
Having said that, and having been in that situation, it can be very disconcerting to fly what appears to be across the path of another aircraft. Turning left seems to feel like 'turning away' if you are in the left seat.