You can also have your passport amended to reflect your name as that by which you are normally known.
All it requires is that you contact your passport issuer and apply to have it changed. A stamp will entered in your passport to state that you are registered as Joseph Alfred Bloggs but your passport will describe you as Alfred Bloggs. Simples.
You can then have yourself legally described as you are normally known on all documents, bank accounts, voter registers etc etc.
I did it over 25 years ago, it makes life much simpler.
Good luck.