If you take the full range of aircraft to include model aircraft, then I can say that the smaller they are, the more wind gusts can disturb them, especially in bank angle.
The smallest airplane I have ever flown weighs just about one ounce, think of it in terms of a paper bag with a very thin carbon fibre framework. It is impossible to fly this model in any wind over 3 knots. Even when flying indoors, if someone opens a door the draft will cause it to quickly roll over.
So I suppose the Moment of Inertia is the proportional factor that you are looking for, and this increases with Mass and aircraft size.
.