Strangely something similar happened to me the other day
My mistake was that I waited for the aircraft to leave the runway before lining up and waiting (it was very quiet and so I thought why take any risks, I may as well enjoy all of this wonderful space).
I then called "G-ABCD Holding" before getting clearence to go.