why wouldn't you go straight from Brighton to Williamstown?
Good observation. There's nothing to stop you from doing that. It's a well used part of the bay too in terms of boating, so if you did end up in the drink (and didn't make the glide) in your 172, chances are that someone would see you and come grab you pretty quickly.