Well said foxmouth.
As an instructor i always teach people to fly as high as reasonably possible(weather permitting) for the reasons you mentioned but also because there is a lot less GA traffic if you just go up to four or five thousand feet. I can't think of one good reason for flying low.