The few times I've flown with children, they sit in the back seat.
No reason in the world for someone to fiddle with the controls unless they say why when your attention should be outside the window, unless this was some sort of IFR training where you're supposed to adapt to changing circumstances.
Fiddling with the transponder?? Were they trying to annoy the local air traffic controllers?