When do you make the fly no fly decision? If it's a phone call to the airfield in the morning to check if there is any flying that day then it’s certainly worth your while going there if the weather is marginal. The weather may well break long enough for a lesson and the time waiting can be productively spent in self study for the ground examinations.
Have you discussed this with your instructor or the CFI to see if they have any suggestions about ways you can drive up your flying time? There may be scope for booking additional slots during good weather periods. Perhaps you could have first refusal on cancelled slots on a good weather day since you live close by and it is easy for you to get there.
There may well be some simple organisational strategies you can use to drive your flying time up from its current 50 mins a month to the 50 mins a week you need for your training.
Stephen