Special VFR is very grey and always has been. They let potentially low time inexperienced VFR pilots into sub-optimal situations with very poor visibility.
My first intro to Special VFR was a very long time ago into Moorabbin. ATC told me it was IFR only, however I could request special VFR if I wanted to and continue as normal. So I did.... let’s just say I was very surprised anyone could fly VFR at the time and it felt like an accident waiting to happen.
If you didn’t know the rules you’d assume special VFR required an IFR rated pilot and IFR equipped aircraft, but without the requirement to follow full IFR procedures. It feels like that’s the way it should be.