VFE
From my reading of the report I have no doubt that the the weather was suitable for the decisions the pilot made up until ATC made a human error (something to learn from, not to apportion blame). He took off in conditions suitable for SVFR. It appears that in the direction he intended to fly the weather was suitable. The weatehr at his point of departure did deteriorate to an unsafe degree, however there was no actual need for him to return. There are plenty of other options around there had he a problem and wished to land. Some of those are in the direction in which he was flying, where he said the weather was good.