Exactly Nitpicker!
It's kind of like the guy who sits there as PM and just watches while the PF cocks up and then acts as if that doesn't make him look bad too. "Welll I was not the PF for that sector" probably won't go over that well on the third floor as an explanation for inaction. We are a crew in the cockpit, and errors by an individual are crew failures if they result in an undesirable aircraft state. There are exceptions of course.
Similarly, we are a pilot group. The AOA's failures are all of our responsibility. You don't get a pass just because you choose not to be a member. In fact, you are most culpable. Imagine the strength the AOA would have if we had 100% membership.