I agree-the only ones who make a big fuss about gender are those in whose lives it is a huge issue, thus betraying their underlying sexist attitude!
If you didn't care much about gender or classify people purely based on the configuration of their genitalia, gender would be a non-issue, as, I'm sure all those with a progressive attitude would agree, is desirable.