I suspect it is the prevailing winds (westerlies?). From the pictures, it looks like the airport, beach, and surrounding town act as a cup and funnel the winds up the mountainside, and probably set up some fierce rotors spinning off the ridge line.
As a touurist brochure noted, the most adventurous part of your stay in St. Bart's may be the flight in.