Well, as someone who has experience with both sides of the party, I will have to side with the controller on this one. I am an American who works in Japan and don't have any problems with the Japanese ATC here.
I also worked as a flight instructor in the late 90's doing instruction for China Eastern airlines's new hire cadets in Florida. Their English skills were non-existent. Apparently they haven't improved at all. We had students departing without clearances then also.