This shouldn’t be an issue, as Long as the packs are selected OFF with the HP unit on, as the pack valves would be closed.
In fact, at where I work we would be in this configuration whilst performing the Engine Start with External Pneumatic Power procedure. The procedure calls for the Packs to be OFF, before powering up the HP unit. The LP unit would still be connected to the aircraft at this stage to provide Air Conditioning.