Well you can fly solo prior to licence issue including taxiing at your away destinations far from the eyes of your instructor, so maybe that will go some way to answering your question.
Why would you need to taxi solo unlicenced otherwise? There may be some insurance issues but I doubt anyone will try and stop you. I've never been stopped and asked if I'm licenced or not!
