Some of the restriction may come from Performance Based Navigation - RNAV and RNP - require the aircraft to stay within a certain margin for separation purpose, both to terrain and other traffic?
Cause then ATC can work.... shall we say.... hands off