MEL are NOT legally binding ONLY after the takeoff roll has begun.
From the moment the plane moves under its own power to takeoff roll, MEL are still legally binding.
The spirit of the sentence is that if you have an APU fire after pushback, first you deal with the fire drills as per QRH, then eventually consider a dispatch with an inop APU, though I guess first you want to investigate the fire damages