Bite the sour apple and work until you have the license. If you don't enjoy navigation right now, nobody will force it on you if once you pass the tests. You can fly the circuit as much as you like, leave it for some advanced exercises without getting in unknown airspace, enjoy yourself in the air in any (legal) way you like. Probably the taste for navigation flying will come upon you one day, perhaps not.
You should also beware that practical cross-country flying is a lot less demanding than what you do during training and exams: once you have the license, you will never to touch that "computer" thing again, except perhaps at renewals. If you fly in more or less familiar areas, say 50 NM or so around your base, you will soon know the visual cues, and feel at home while merrily bimbling around. If you go further afield, GPS is inexpensive and generally very reliable - though of course you should always have a plan B.
It has been stated above that you can stop for now and come back later if the mood comes upon you, That is not incorrect, but that way you would be throwing away a good deal of effort and money.