Worst case is it will make some annoying noise on the intercom/radio which might piss your instructor off
I believe that at least one case of it also causing the VOR needle to point in the wrong direction has been reported, although this won't matter (as long as you're not relying on the VOR needle for visual navigation!) except when doing the radio nav part of the course.