Would you quit (if you weren't self-employed) a job because of some retarded colleagues? What if everywhere there's handful of people you don't like? You just have to get on with it.
Did you start training for the love of aviation? Or just the image of shiny airline career dream and nothing else? There's more to life than work. There's more to aviation than airlines.
There's not enough detail from your post, but I presume you started integrated training. As you likely know, jobs are not plentiful with SE VFR CPL in Europe, especially UK, without FI rating.
You should base your values on the opinions of those who matter to you, not people who don't matter. I don't know your experience, but remember that integrated courses filled with 18-21yo who either managed loan or sponsored by bank of mum/dad, are there often for one thing. The dream of shiny career/lifestyle. I see nothing wrong with changing your opinion about finishing the training in place that's not the 'right place' anymore.
Whatever you decide to do later, try to get all the documents, training folders etc in place, logbook entries signed/stamped as necessary etc. I guess that should be fine, since you say you did your CPL LST.
If you want to stay in aviation, with SE CPL, think of instructing at small school/club. Far from integrated wannabes and overpriced stuff. It would earn peanuts compared to what you do, but it's doable to combine it with your current profession. Or at least keep current, flying for fun, buying into syndicate etc.