Wingswinger
You have hit the nail on the head. Its not really to do with phase.
You start a take-off and if you take TOGA during that take-off you dont get GA modes. If you end the take-off by selecting different vertical mode or by passing into climb phase (just a trigger condition) then the GA mode is available from then on.