The other option if you encouter concentrations of gliders away fro a pukka gliding site is to descend a bit. They're normally trying to gain or keep height, and unless they've binned it they'll want to go up.
However, how low you go is the decision - if it's your solo nav speak to your instructor about this.