This is because BNO holder has the right to work and live in UK without a visa. That’s a different story, it is total nonsense to compare passport holder with a visa holder.
And apart from HK, can you tell me in what part of the world a visa holder could have ldisplaced the position of the citizens?