I guess the whole thing boils down to airmanship at the end of the day. I am no expert in any way shape or form, but, if someone believes they are in the circuit, they are going to carry on regardless. As pilots we have a duty of care to avoid any unnecessary conflict in the air or ground, and if that means you have to go around even though you are in the right (or have at least have right of way), then so be it. I would rather go around than end up in pieces on the floor. You can quote the ANO until you're blue in the face, but it doesn't mean bloggs is going to follow it to the letter - so what if it costs you an extra 10 minutes? In my view, there is no point in getting wound up by it (especially in the cockpit) as this is just going to cause you stress and increase your workload (this may not be true for all, but certainly for me as a low hour PPL).
If you want an interesting time, visit White Waltham on a busy Saturday - Pitts and Tiger Moths flying tight circuits, 6 or 7 studes in the normal circuit (+- 100'

), visitors flying wide or tight circuits, its also a/g radio and accepts microlights and non-radio acft. You just have to keep a good look out