Overkill in my opinion, the pax's bags had just been accidently loaded on to the wrong flight, if they had no part in it and it was a pure cock-up then why turn back. That said, if the company wants you to turn back then you have little choice, it's thier aeroplane after all.