As stated by Barling Magna, of all the "London" airports only London City is in London (as mentioned in their current advertising campaign).
LHR is in London in the mind of Londoners in the sense that we see London as being the bit within the M25. City is in Newham (!)