"Square" is derived from the Latin phrase exquadrare, like a quadratic. Over time the term was contracted into its present form, and came to mean the regular quadrilateral. The word is also the root of the military term "squadron", which originally meant a fighting square from the early practice of fighting in square formations.
There we go!