It is most probably the speed brake being extended or retracted. It makes an odd whistle noise especially noticeable on the ground.
I once lived directly under a nav aid used in a STAR into MEL where last minute track shortening would often occur. Often you could tell if an A320 was high when you could hear the odd high pitched noise without actually hearing the aircraft itself.