Jaba
Many years ago I held a permit from CASA to carry a revolver on board any aircraft that I was PIC on
Only had to send a copy of licence to CASA with a request.
It has been expired for approx 13 years, so not sure how & if things have changed.
I went via my FOI and never had a problem - had to be renewed every two years from memory.
Good luck