I think some routes suffer from cultural differences, often some folk won't understand whilst others, usually the majority, simply choose not to listen. From your discription, the gate staff did all they could to control passengers. Short of having cattle prods and tazer's, what else could they be expected to do. Many people complain of being 'herded like cattle', some would argue that it is required.
Baggage is a separate issue and "generally" speaking the gate staff do a good job at dealing with baggage. Passengers can always assist by stowing the luggage correctly and not stuff large jackets into parts of the lockers that could and should accommodate an extra bag.