Mate,
It's not a problem. In fact, I see my kids more than any office worker. As a SO you will only be away from your family between 9 and 12 days a month(flights normally leave late at night and arrive early morning). Plus, you get to catch up on your sleep when you are away...Bonus....
I would not even be worried about it at all.