Hey Josh, I am saying you can do whatever you like if you own your own aircraft.
BUT if you are renting from anyone I am guessing they will have the final say in where you can fly and what you can do. From my experience I reckon I could get the average beginner RPL lost within 25 nm of a lot of airports. Which brings me back to Mutley's post: Why don't you just get a navigation endorsement.