Another Biggles,
I think I have the drift of what you are saying.
It seems to me that someone told you flying was difficult and complicated. I'll let you in on a secret. It ain't!
As Big Pistons said, it's usually a confidence thing. And +TSRA said don't confuse speed with competence. But a methodical approach is very efficient and a lot faster than you'd imagine.
A few things to consider.
Try getting into a 'warm' aeroplane. Perhaps brief the previous user that you want to get off quickly so they might check the oil and fuel are sufficient for your detail.
Bear in mind, at aerobatic practices, we used to do running changes where the engine would be running for 2, 3, 4 or more pilots.
You don't need to have a plan. Just go fly.
See how long you can go without looking at a map or checking a log.
You don't need to talk to ANYONE. Just go fly. In peace.
Try diverting. Start following your route and then go somewhere else. Remember how long your finger or pen is on a map and your 60 rule.
These things should give you confidence and will help you sort out 'nice to know' and 'need to know'. Need to know is a VERY small list.
This confidence will help you. Minimalist is the way to go.
Enjoy your new found freedom.