A couple of years ago I did +6.5 and -3 G as a passenger in a Pitts and loved it. So much so that I gained my licence and am flying aerobatics in a Pitts myself now.
I think the thing with aerobatics is that doing a loop is easy. But flying a perfect one every time is very hard. There are too many variables. That's what keeps it interesting. For me it's not about throwing an aircraft around the sky. It's about accuracy and finesse and energy management. Even in competition flying, the high-G square loop flying is only found at the higher levels.
It may be surprising to some how quickly one gets used to different attitudes. The very first hammerhead feels very strange. But after a couple this just goes away and you're focused on trying to improve technique and don't even think about going straight up or down.
So, aerobatics: I love 'm . I can always fly straight and level later...
I think this photo sums it up very nicely.