Everybody is scared to a greater or lesser degree at different times, but if you're bitten by the bug you keep getting pulled back to it and there's not much you can do about it.
The more you do it the less scared you will become generally, but if you keep going there will still be times when you're utterly terrified and vow to give it up, though you never do.
Welcome to the club. By the way, did anyone tell you it will bankrupt you too? And put a huge strain on your relationships? It's a great hobby.