I'm sorry; I should have been more clear: I was asking when to leave the offset when it's "clear and a million" --not when there's ANY low ceiling or vis.
I also found out, the offset was designed for airspace reasons, not obstacles nor noise abatement.
And, yes, the opinion of the tower controller is "just" an opinion, albeit an important one, but not a regulatory statement.
It seems after all our posts, the answer is still in the "grey" area...
thanks,
Mike