I think the idea might be that UK jobs will be given to UK citizens and the EU will be prevented from sending its unemployed young to UK. There will be a barrier to working but not temporary residence for courses or tourism. A bit like it was before the UK entered the Common Market.