Whilst learning to fly PPL and Gliding, I used to cram in as many lessons in a week as possible, which meant accepting some challenging weather conditions.
However one day the wind was given as 12kts straight down the runway 05, which seemed Ok at the time. However when we had done the power checks, and were at the runway holding point, we were told 'LR cleared for take-off, wind 090 degrees 15kts gusting 20kts'... Although that was marginally within limits, we decided to cancel, as it could have got even windier in the next hour. So we made a quick U turn and RTB. That was the closest I got to flying but didn't.
Nowadays as a PPL, myself and others can wait for Gin-clear days, when my passengers can get some good photos. Some light aircraft owners also wait for non-turbulent days, as they prefer not to be thrown around the sky by thermal action.