Much better a good approach to a poor field you can make than a poor approach to a good field you can't make
I doubt minimum sink speed speed in a SEP with dead engine will buy more than several seconds in the way of think time.
Turning downwind and slowing down to a few kt below best glide will give you the most selection of fields - caveat that you're not over hostile terrain in which case you are advised to know exactly where you can find decent landing opportunities.
Gliders do have an advantage over hilly terrain compared to engined aircraft as a 40+ glide ratio can take you a long way over hostile terrain.