Not a question necessarily of mistrust - I have to admit that I've never flown an Airbus, so I find it hard to imagine, but I think I would prefer to have an idea of the other pilot's inputs to the controls for one thing.
Also I can imagine several situations in which the first sign of things not being as they should is, say, an unexpected autothrottle movement...