You will get it, 5 hours isn't bad. Nothing like hover practice to wear you out and overwhelm you really fast. You need to only do a little at a time. If you practice any more than a few minutes solid it maybe be frustrating and counter productive in my opinion. Pretty sure I had about 30 hours of instruction in maybe more before I could hold a steady hover. So I can't say it came easy to me either. I found the R22/44 harder to hover than say the Hughes Schweizer 269 platform. The key like some of the other guys have said is to look out. if you look close in or right off the nose it all goes bad quick. When I got rusty after not flying for a bunch of years. I found myself looking too close and the hovering wasn't all that pretty until I remembered to look out. If you look kind of straight ahead it smooths things out and you kind of feel your position from the peripheral vision mostly and glances here and there. .
It is worth it once you master it. I still go out and practice squares, nose around a point, tail around a point. Once you can hover you can go out and fly a good hour or so with just hover practice and slow taxi's and not ever even have to go anywhere! Can't do that in a fixed wing! Flying helicopters always puts a smile on your face.