And it's not just the effect on the wing that you have outlined nicely. The horizontal stab generates more drag the more it has to "work" to keep the nose up. This drag, known as "trim drag" also must be added into the equation. The higher AoA may also lead to higher parasite drag due to less than ideal fuselage angle, etc.