Aye, it's a good question and something that I've noticed myself. A number of times I've observed the speed get low (or high) without the speed window, so have then 'speed intervened' at the same speed as already selected then watched the thrust levers spring into action....