I'm in more or less exactly the same position. It just doesn't seem worth getting an IR at the moment.
I seriously considering converting to microlights and getting qualified as an instructor. The pay is better than group A as you don't have all the wannabes doing it for the hours and I think it could be quite good fun.
I wont get many hours in and it will never be a full time job as like you, I have a well paid career outside aviation but it will keep me in the air.
I used to be attracted to the most complex machines but I have started to go in the opposite direction now and have noticed that the LAA and Microlight guys get much more fun for a lot less money.