Ryanair and Thomson combined account for 16% all all passengers which is still a sizable amount. I would think they would be sorely missed if they went but I can't see that happening.
With a bigger Luton the airport would be keen to see more activity from these airlines. Why would they want to leave a rapidly expanding airport?