The first few hours are an interesting time.
Your brain is trying to reconcile the romantic notion of flying to the reality of a light piston trainer. The "reassuringly expensive" Robinson experience can also take some adjustment.
Suddenly a few feet off the ground feels incredibly far from mother earth and all those Hollywood movies where helos manage about 30 seconds before ending up in a fireball starts popping into your mind.
Everything tenses up and then the simplest of tasks starts feeling challenging.
Speak to your instructor. A good one will put you at ease.
Relax, this stuff is fun and you can only learn to hover once.
Enjoy it and don't put pressure on yourself.
The system usually works, your instructor won't give you more than he feels you are capable of and he won't want any black marks on his record.
Some people choose not to continue, they work out it's not for them or they get the romance out their system. It's not for everyone but stick it out, the bug does bite and afterwards you sometimes regret it did