Surely you select the assigned speed and if the autopilot drifts a few knots fast or slow it doesn’t matter? If you can’t select the speed due to performance limitations you tell them. If you purposefully select a speed at the edge of some supposed “buffer” then you deserve to be pulled up for it.