What Jock says. But, in direct answer to your question:
FCL.1000(c)(2)
The certificate referred to in paragraph (1) shall be limited to providing skill tests and proficiency tests/checks:
(i) outside the territory of the Member States; and
(ii) to pilots who have sufficient knowledge of the language in which the test/check is given.
FCL.1005.SFE
(a) SFE(A) and SFE(PL). The privileges of an SFE on aeroplanes or powered-lift aircraft are to conduct in an FFS:
(1) skill tests and proficiency checks for the issue, revalidation or renewal of type ratings for multi-pilot aeroplanes or powered-lift aircraft, as applicable;
(2) proficiency checks for revalidation or renewal of IRs, provided that the SFE complies with the requirements in FCL.1010.IRE for the applicable aircraft category;
(3) skill tests for ATPL(A) issue;
So yes, the examiner does hold a certificate permitting him to conduct the ATPL skill test. However, since Sweden has not yet fully implemented the EASA implementing rules, they do yet not have to recognise a certificate issued by another member state.