The way I see it as long as you stay under the limitations you are doing just fine. If they wanted you to fly slower with the flaps and gear out they would put it in your manual(s).
We are paid to fly airplanes not "play" structural engineer and guess/assume that we should operate below the limits. There is no reason to do a 360, especially when you need to get to the hotel bar for drinks.
The limitations are for normal operations, not emergency circumstances... If do don't agree show me where in your books it lists "Prefered Limitations, or Limitations for Normal Use." Untill a my company publishes "Recomended Speeds" that are lower than the current limitations I will use the limitations as my guide.
In an real emergency if I'm 20 knots fast and I want the gear down it's comming down 20 knots fast, same thing with the flaps.