Wrong. Switch them off and if you are below 300, take off. In 9 year's A320 series flying on aircraft both with and without fans I have never seen temperatures go up more than 20 -30 degress after fans have been turned off.
If you have carbon brakes, they are most efficient if temperatures are in the range 150 -200 when heavy braking commences.