Hi,
I believe some do confuse Both FD's OFF and ON together with doing them simultaneously.It should not be done simultaneously for the reason Tiennetti has mentioned.
However they should be both ON or both OFF together.Has an impact on Auto Thrust modes.One of the reason for A320 accident at Bangalore if I remember correctly.