You're being unnecessarily conservative.
(a) loss of baggage/freight restraint is out of left field and independent of loading trim philosophies. It's not going to matter one iota where the load started if it moves unrestrained.
(b) movement of crew and pax is normally addressed in the design of the trimsheet and operator training in load control procedures and ought not to be a problem.