Too Few Stripes: Packs can be only damaged if they are operating. They are not operating if the switches are in AUTO mode if you don't have any pneumatic source from engines/APU/HP ground source.
Conditioned air from external air conditioning unit is a LP source and is connected downstream of the packs - into the mix manifold to be exact. Also, there is a check valve located after the pack itself to prevent reverse flow.