You're right about floodplains of course, Nutloose. Trouble is, this is a small island, lots of people want houses to live in and they have to go somewhere.
The answer, if there is one, has to lie along the lines of your second paragraph, in making buildings flood tolerant. Most people wouldn't want 5metre flood-walls throughout their town centres even if there was limitless money to pay for them.