Would you feel any guilt if an area or approach controller had an overload because of you disregarded the CTOT?

CTOTs are there for a reason. Nobody likes them, but they aren’t put in place arbitrarily. They primarily protect ATCO workload, which in turn protects pilots, and the flying general public.