The ECAM procedure requires evacuation of the lower deck crew rest (which is in fact in the aft cargo compartment) prior to firing the cargo bottles, so the agent seeping in shouldn't be an issue. But yes, once smoke is detected in the compartment, the isolation valve will close, so the buzzer would be an early wake up call! What's wrong with a partially robed hostie running through the cabin anyway?