@ TU14 and others, thanks for your replies.
I was of the impression that it wasn't unusual for PAX not to board and that it isn't something that is necessarily sinister.
I can also imagine that it is a PITA for all concerned, not just the ground staff, but also a pilot trying to make a take-off slot - along with us SLF, who get to seethe ground staff unloading luggage.