I feel your pain Shy...
The ironic thing for me now is that after years of working weekends, in my current job I rarely now have to, but as most of my friends are still "weekend warrior" type pilots I still have no social life as they all go out during the week...
Unfortunately I don't have a back up pilot to cover me so, no being off sick, only schedule appointments around work, and only go on holiday when the boss is away on holiday...
However, all moaning aside (and all helicopter pilots I know are never happy and moan about everything anyway) I know how lucky I am to be doing something I like (which pays the bills, just about) especially in these hard economic times, and I remember how keen I was starting out all those years ago, so if your willing to make the sacrifices and REALLY REALLY want to do it, well, you only live once so go for it.