Yes. The laws of physics (backed up by an enormous volume of scientific evidence) state that:
Force * Perpendicular distance from centre of mass = Moment of inertia about the centre of mass * Angular acceleration
Since the first three are all non-zero in your scenario, the angular acceleration must be non-zero too. If applied for a non-zero length of time, this will result in a non-zero change of angular position.