Well for a start, if you pull speed you exit SRS mode.
Not a perfect solution.
Also I think it gets a bit complicated...too many actions in a high workload scenario.
Is that the SOP your company uses?
I know - its possibly better than starting an immediate acceleration (by pulling ALT), but its still less than ideal.