From Our company A320 MEL ref Flight Directors:
*(o) Both may be inoperative for ops to Cat I minima or better.
It is therefore acceptable to depart with the flight directors inop as long as the weather isn't so poor that we would need to autoland. I wonder how our passengers would feel if we were to depart with them inop having never done a flight director off take off.
I'm just playing devil's advocate here as in 3500 hours on type I never have done one (our company prohibits the practice of them although we are encouraged to maintain profiency in all levels of automation).