This is something that often isn't given much thought.
Have a think about examples such as KLAX, where a miss prior to DA will often require you to DESCEND. Due to airspace aircraft cant be higher than 2000'. When all we practice involves hitting TOGA, this can make you stop and think a bit!