Yes, it is annoying when you make the effort to pre-book a seat and even pay cash/air miles for a specific seat and then they want to move you for someone who never made the effort but is more 'deserving' in some way.
As ExBAW has already noted above, it does make a mockery of the pre-book idea.