Seems like this is now the advice given by Airbus on the A318/319/320/321 in case of an overspeed.
We did it in the sim a few weeks ago; from stowing the speedbrake leaver, it was 27 seconds till the flight control page on the ECAM showed they had fully retracted.