Fixed is much easier and cheaper to do. It also gets you a long way towards a rotary licence. A fixed wing wants to fly and you just have to get it to go where you want it to.
A rotary does not want to fly and you have to make it do so all the time, in other words it is dynamically unstable. The best analogy I have heard is "controlling the flight of the bumble bee". You need a few hours to train your brain to drive it, but after you get through the pain it is magic.
I learned to fly fw when I was much younger and it was relatively easy at the time. I then discovered helicopters about 20 years later and found it much harder. However now I fly both and switch between them with no problem whatsoever. I would advise fw first, then rotary. Suffice to say my flying now is about 80% rotary and 20% fixed and I have both available 24/7.
Good luck whatever you do.