My own understanding is that one should let the speed stay "managed' as this would be the most efficient way of getting up there.
This depends on what you mean by "most efficient", with the correct CI in it will be the most economical, but it will take longer to get to alt. than at lower speeds (down to GD) and there can be all sorts of reasons you might want to do that.
