You worry too much, probably because you listen too much to people who tell only one half of a story.
Just fly and enjoy it.
If ever you're tempted to do the kinds of things that attract enforcement action by CASA, you'll have a strong, uneasy feeling somewhere in your nether regions.
