Sounds like you enjoyed the adventure but not flying for flyings sake. So take a break and wait for your son to be old enough to come with you.
Try aeros, tolerance builds quickly. If you don't like them, fair enough and awful lot of pilots don't. If you do you practice for competions etc, you only need to fly in the summer months and trips are short. Also the nature of the beast means that there is always room for improvement, more accurate flying, more figures etc. can't do anything about the weather though......