Airbus literature states that the feed-back servos ensure that both sticks are always in the same position. This lets the non-control pilot feel what the other is doing.
You have no idea what inputs the other pilot is making when in-flight.
If you both use the sidesticks simultaneously, you get a "Dual Input" aural warning.....