It's actually less complicated than that.
Remember the Boeing factory is one of the largest (certainly one of the longest) buildings in the world. It was built before the days of laser surveys and as a result has a very slight curve built into it. Due to the direction of the production line, this manifests itself in microscopically curved aircraft hence the need for trim.
I just wish I'd thought of this a few days ago.
