In the formula of drag, increased S can significantly increase the induced drag.
Or another problem is that an increased S can increase mass.
Increased S can also decrease CL, depending on how the additional surface is won.
The only reason is increased weight, presuming both wings are of similar design/technology. An A320 with A380 wings which somehow weighed the same as a regular A320 would be far more efficient.