I started off like you, one hour a month (but then it was £30/hr...). It didn't work well and I took out a bank loan and did it all in 2 weeks.
30 years later, it has cost me a lot of money, and no doubt I'd have a bigger house and a fancy car (and still have a wife) but I wouldn't have had half as much fun watching footie on TV. Life's what you make it and I chose to fly aeroplanes and sod the cost.