I see absolutely nothing wrong if I see I'm off track in flying to a feature that will put me back on my planned track. Far better than flying into something I had not planned for.
There's absolutely nothing wrong with that at all. That's the basic skill of pilotage; being able to correlate what one sees out the window with what one sees on the chart, and thus navigate from one point to another.
Flying along one's course and meandering a bit is called "bracketing," and it's been taught as a part of navigation for many decades now. Fly by pilotage, you're probably going to bracket your course. Fly by VOR, and if the needle drifts left and you correct left, you're bracketing; you're constantly returning to your course, making corrections here and there, but you're doing it by keeping within an acceptable distance from the course line; you're bracketing the course.
A few years ago we had a first officer who was flying a leg. The Captain with him pointed to an airport ahead and asked him what it was. The First Officer didn't know. The captain pointed to a nav display that showed an airport in that position, and asked the copilot if that might be it. The copilot looked at the nav display, then at the airport, then back at the display, and said there was no way that could be the same airport. Why, asked the captain. Well, said the First Officer...that airport down there doesn't look anything like the little symbol on the moving map. (All the airport symbols were identical). He was one of those who routinely went from A to B and let the gizmos do the work for him.
An E6B is a circular slide rule; they come in plastic, cardboard, paper, metal, fiberglass...and some are even electronic. I use a good old fashioned aluminum one that's lasted many years. Some of the numbers long wore off, and every once in a while the face gets some clear ladies fingernail polish to keep the rest of the numbers from wearing away. But it still works, and of course, hasn't required a single battery yet.
I didn't get into flying airplanes to keep my head in the cockpit. I fly so i can enjoy flying, looking down, looking around. Pilotage is the heart of getting from A to B, and certainly one of the most enjoyable parts. It's navigating alright but it's navigating by looking around. And yes, it can very easily be done by seeing what's ahead, flying to that point, seeing what's beyond that, looking ahead, and flying to the next place of reference. Just like magic. Or driving a car. Or walking...but more expensive and considerably more enjoyable. Isn't that what private flying is all about??
I should add that when I was crop dusting in the flatlands of kansas many years ago, we often navigated by flying close enough to read water towers and road signs. Towns with water towers put the name of the town in big letters around the water tower, so flying to a town and reading the name was quick and easy way to find your way along. In days of no electrics and no radios, it worked just fine...and it still works fine today.