I am sure that those who fly with that system get used to it. Well, I guess that most do.
and presumably the pilot who crashed through being low and slow approaching SFO on a manually flown approach ? It was reported that although hand flying he had engaged the auto throttle, but in fact he,or it, hadn't actually engaged, so being fresh off the Airbus and new to the B.777 he presumably wasn't concerned that the throttles weren't moving ? There were other factors of course, but I bet that was one of the "holes" in the cheese ?
Murphy is always with us.