You're quite right, in the air it matters not to you where the controller is located. On the ground its a bit different, especially for units who are not very experienced in talking to 'London Mil' and don't know whether to ring West Drayton or Swanwick

Hope that clears things up a bit.
BD