I asked my CFI - he said that solo flying between completion of the course and grant of the licence is OK.
I'd say that ultimately the final word lies with whoever you are doing your training with. You are flying their aircraft on their licence and their insurance - it's up to them whether they let you fly solo whilst you are waiting?