OK, I see what you mean. You can change the field that is displayed by my method but you can't remove it altogether. The reason for this is explained in the settings panel, if you took it away there would be no sort order for the appointments.
However, if you create a whole day appointment, which I suspect is what you were doing, voila, no time is displayed.
Does that solve your problem?