It's actually called 'Schengen' agreement. And as far as I know the Brits don't fully recognize this EU agreement, hence the passport requirement, and check when going to or coming from GB.
When travelling through the EU you still need a form of ID anyway, a passport or EU ID-card.