Similar to what was mentioned before, stick shaker just after takeoff because you got an airspeed loss after previously having a gain and retracting flaps is not a nice idea at all. Would much rather exceed flap limits and deal with whatever that might bring (IMO probably nothing unless something really weird is happening).
As an anecdote, a company I previously worked for (flying something single pilot and lighter) had a pilot who for over a year didn't know what the limiting speeds for the first couple of stages of flap, and exceeded them probably numerous times a week until he finally did the same thing on an OPC.