Hmm... your instructor is concerned about your helmet causing damage to his head. He would prefer that your bare head caused the damage?
VP's point about inertia is important. Mil helmets are normally kevlar. Very light and very expensive.
The point is still good though.