My own advice from an eminent barrister specialising in aviation cases was that it is a brave individual who goes to court against the CAA as they seem to have the ability to blind a jury with both the ldazzle of their legal team (no expense spared) and their percieved might and righteousness as the Mighty CAA.
I don't know who you spoke to but I profoundly disagree. I have defended a number of cases against the CAA and have not lost a single one in recent years. The interesting thing about the CAA is they do not use "aviation" lawyers to prosecute. i.e. lawyers who are qualified pilots or who have practical experience of aviation matters.
One even once told me "The Authority offered to arrange for me to go flying but I told them you're not getting me up in one of those things."
It is extraordinary how often cross-examination of the CAA experts by someone who is conversant with aviation practices completely reverses their case with the prosecution simply not seeing it coming. I don't in any way seek to criticise any individual lawyer, in my experience they have been experienced and good criminal barristers - just not pilots or total or even partial aviation people.
I would hesitate to give any opnion on this case without a lot more information but I echo what FL says, you need to get a good aviation lawyer with access to good experts.