You can fly anywhere in a VH-registered aircraft with an Australian medical and licence.
The FAA requirements might seem tough on paper but there is a provision called Special Issuance in the United States that the FAA tend to apply fairly liberally.