I would say that you could safely go within the legal allowed, that would be 500' (or 1000' if you call the carrier "populated").
I would also argue that what is supposedly the most advanced navy in the world would know who you were, where you had come from, what your likely intentions were and what was legally permissible in Australia, long before you arrived on upon the scene.
That said, I am not testing the theory!