I found a publication on
RAF Visual Requirements. (pdf file)
To be a pilot, you need CP2. It comes as no surprise really, but it's still a huge disappointment to me.
However, the requirements for UAS seem significantly less strict, which is good news at least. I may still have a shot at that.