For how long was your speed below Vls? Was there turbulence? If it was only momentary, and you immediately corrected, he may have been a bit harsh.
Vmc aside, the plane can safely be flown below Vls, but I’d say there needs to be a specific reason for it.