Well there is, but on Airbus FBW the TOGA buttons are inside the thrust lever quadrant - not external on the thrust levers themselves - so they can only be activated by clicking the thrust levers fully forwards.
So in an Airbus FBW you have to deliberately select TOGA with the thrust levers; you cannot bump the switches by accident.