So how the hell are EASA going to establish that I'm a resident there
EASA is not the enforcing agency. They just sit in their Cologne offices, smoking stuff. Although the passport might give some hints, I don't think enforcement of the rule is going to be very feasable. The problem is insurance. If the flight turns out to be not "legal", then the insurance company might weasel out in case of an accident.