Agree that you should use the privileges you have. It's why we fly
However, I also agree with the earlier post about small steps. Specifically, try to only introduce one new aspect to each flight.
E.g. renting an aircraft you have not flown (or flown little) to go to a new place in weather which may be slightly below what you are used to ... with someone with you for the first time... may end up being a bit much.
I had flown about 6 hours with passengers whilst still taking lessons (and an instructor next to me as well, for sure) because I wanted to do fun stuff earlier rather than later. E.g. why just do a nav exercise when you can go to Compton Abbas for lunch with someone?
Even so, after I passed my GST, I felt that I wanted to consolidate what I knew before I took someone else up. I also wanted to take passengers in a slightly more modern and higher performance aircraft and I wanted to get a tailwheel rating ... so although I passed my GST after 47 hours, my first passenger as PIC wasn't until 74. I didn't set out to have such a gap (although I initially felt I wanted about 10 hours of "me-time") but circumstances just happened that way.
During that period I also brought my 'airfields visited' total up from 9 to 18, dropped in on some short strips, flew 4 different aircraft types and logged some long flights up to 3.5 hours; in general I felt far more at ease and confident - not so much whether I would be able to conduct a safe flight - I was always confident with that - but also that I could make the flight as pleasant as possible for the passenger(s) and deal properly with any eventualities.
A thing to remember is that it's not just about you, it's also about your passenger.
YMMV ;^)
B.