For VR work the "reference" becomes the load which you fly as if it is the aircraft.
There will be a control delay which roughly equates to half the period of the pendulum which will increase as the line length increases.
A tip for height is if the conditions are suitable is to use the shadow of the load.
After a while it becomes second nature like a normal hover.