There were/are two swimming clubs along the north coast; first, the Chinese Swimming Club at Tanjung Tokong. The second is the Penang Swimming Club at Tanjung Bungah. Both are still active.
The Chinese Swimming Club was exactly as I remembered all of those years ago and I am pretty sure we called The Penang Swimming Club, The Australian Swimming Pool......very different now to how I remember it.