Also remember that S speed is not the only condition for retracting. The trend arrow should be showing acceleration and if you are in turbulence, you may delay retraction 20 kt or VFE-5 kt. If trend is erratic, you are in turbulence and speed may well go below S again.
If on top of that you have a RWS going on, man… The procedure is crystal clear.
You had some negative training that day. It happens from time to time.