Its as safe as anywhere these days if you take sensible precautions like locking cars and houses windows etc etc. I never drove anywhere near the 'dodgy' areas in Joey and always rented accom with panic buttons and guards which is standard.
Just common sense really.
Fantastic flying:- south is extremely beautiful with mountains desert and whale watching, east also great Durban really fun place and Joey good experience for traffic and ATC.