Why push the toga button if you have to climb 500 ft? It will scare the hell out of all of your passengers.
A couple of years, as a passenger on Lufthansa, we were approaching Cairo at night. We were around 1,000 feet when all of a sudden, they hit TOGA and pulled up sharply. It did scare me and some others. It turned out that the plane ahead of us had not cleared the runway expeditiously and we were told to go around. It was obvious to me that there was no reason to go to TOGA, just policy.