If you are operating VFR, without an alternate, and without enough fuel to divert to your departure point, then you should calculate your PNR. In the calculation, your endurance should not include fuel reserves.
The speeds used are, of course, groundspeeds, i.e. dependent on the actual wind.