It's not about impressing, it's about being comfortable and relaxed. I certainly won't be wearing (and haven't worn) my best bib and tucker in the sandpit, but the ability to put on a t-shirt and a pair of shorts and flip-flops makes life, if not actually pleaseant, then at least more bearable.
Why make life harder when it's a pain in the ass anyway?