Um, maybe I'm missing something here. CASA is the regulator; it is the policeman of the air. There is no-one else who has that responsibility. Now if they perceive that someone has broken the rules then they have a responsibility to bring the full force of the law (in this case the regulations) to bear. There are some in GA that don't think the rules apply to them.
In the absence of a points system (which I think seems a reasonable way to go), then CASA really has no choice when they find out, or think, that someone has been busting the rules.
If there is a disagreement, then that is what the court is for...not a lot different really from some motor vehicle misdemeanours.
Afterall, if there is an accident and the ATSB highlights shortcomings in CASA's oversight of the pilot or operator, then we hear all the 'tut tuts' from the industry.
And let's not forget the insurance issue. The insurance companies these days will happily not payout if there is a whif of rule breaking.
CASA must apply the rules and apply them fairly, without fear or favour. That can be a thankless job even if done well.
And no, I am not a CASA apologist, but I think that we have to recognise the limitations of the system we all work under.