I think longer wings, more wetted area, gliders etc will add drag at low altitudes, but will increase in efficiency the higher you go. And the opposite for aircraft wit less front surface. So down low the smaller and the higher you can make the wing loading, the better. Up high it's the opposite.