Here's a (simple) comparison - Try steering your car with the left hand and then with the right hand only.
The movements themselves for controlling the aircraft are fairly straight forward. Push, pull, left and right.
When it comes to something like hand writing, remember how long it took as a child to teach your brain and hand, and to build up the muscle memory to make those small, precise movements. Compare this to steering left and right in your car.
I'm not trying to say that flying doesn't involve precision, or isn't an artform in the right (or left
) hands just that I don't think (or haven't experienced) an issue when it comes to controlling with the left or right on yoke or side stick.