Surely, ATC can only withhold take off clearance if instructed by a higher authority. When it comes to weather the airport authority could close the airport but if the airport is open the Captain's decision is final, the warnings of ATC might have relevance for the subsequent enquiry/court case though.