However just because a part of the aircraft is not de-iced or anti-iced does not mean it's ok to take off with ice there. All critical surfaces need to be clean for takeoff, whether they have provision for de-icing or anti-icing in flight.
Sooo... to provoke a bit: You can fly around with thick ice on the stab, land or make a single engine go-around with ice on the stab - but you cannot take off with a thin layer of ice on the stab? What's the difference?