Perhaps the use of armrests should be optional, after all, this is how they were designed.
I have seen them greatly increase the smoothness of pilot inputs in good conditions, but on the other hand, seriously limit the ability to make large scale aileron deflections when needed for avoidance action or turbulence on the flare.