That said, when the initial roll-out and targets were announced I can't recall a groundswell of opinion that it wasn't fast enough (that could be down to bad recall).
Your recall is accurate.
There wasn't "a groundswell of opinion that it wasn't fast enough" because Scotty was telling everyone it wasn't "a race" and, back then, people were putting more trust in him than they are now.