I assume we're talking about a field with ATC?
I think it's true to say that yes, you can only backtrack if specifically cleared to do so. However, what is certainly true is that if there is any doubt at all, ASK! I suggest something like: "G-CD request backtrack".
FFF
-----------