I agree - uniform and flying skill / ability are two totally separate things.
Uniform is for corporate identity / tradition and professionalism and can't ever be linked to flying ability.
As you quite rightly said - if you need a uniform to fly then quite right - you're stuffed!