Unless you encounter VRS from the hover in zero wind in a vertical descent or are downwind, chances are you will have some forward airspeed, even if it doesn't register on the ASI so forward will be better and quicker.
The lateral control input might change the disc attitude slightly quicker than forward but you still have the same amount of inertia in the aircraft to move and you are trying to drag it sideways through the air.