In our company we also go that way. "Speed deselected - manual fight".
But there two things to remember. First, if you decide to fly manual before glideslope capture, the speed mode comes active on capture and the present speed is displayed on MCp panel. You must deselect again and call for proper speed on MCP. So I use to take over manual after glideslope capture and the problem is solved.
The second point is the question of what speed is to be set on MCP when in landing configuration. The A/T-systems has a build in gust compensation so Vref+5 must be set on MCP. But in normal operation everybody does set the speed including correction for wind when in manual flight with speed deselected. For automatic approaches with autoland we set vref+5 on MCP. What is the right way?