I suspect that it may just be because AoA gauges are pretty much universally mounted on the fuselage. Selection of the flaps moves the chord line nose-down, and so a (for example) 13° AoA at the wing, will read more nose-down (lower AoA) on a fuselage mounted gauge than it did with flaps up.
G