I started just over 3 years ago at the age of 36. The only downside of starting later in life is that I wish I'd been able to afford to start flying sooner. I'm now Chief Pilot for a small tour and charter company flying a Twin Squirrel. I've been quite lucky at a couple of points in my career but I've also been very dedicated. You make your own luck in this game. If your motivation is there I'd say go for it.