The fuselage without windows would weigh about 25% less.
A fuselage without any windows at all (which isn't what we're talking about here) would be far lighter than that as there would be no need to worry about any passengers wanting to fly in the thing ...