Spent 2 tours there in the late 90s and early 00s. Arrived there thinking "what a ####hole" (had to drive round the perimeter twice to find a way in!). 7 years after that intro and I'm happy to say they were some of the best of my life - if you go there and are determined to be miserable, you'll be miserable. But you are on the doorstep of some of the most beautiful beaches in the land and one of the remaining counties where community means something. Some of the pubs are astounding- but you have to explore to find them.
We ended up living out in Castle Acre (a village north of Swaffham) which has loads of character. We loved it there and hold Norfolk very dear to our heart.