Lots of variables - why you diverted in the first place, wx, distance for pax etc
Yep, that sums it up, and I'll throw in Duty Hours left available...because if the crew runs out of hours it throws a complete spanner in the works.......
On one hand if you have got duty hours to spare and if you've ended up at an alternate a fair distance from the planned destination you'll probably sit it out on the ground and fly on to destination when/if you can ( and FWIW in some countries the authorities can make it very difficult, if not impossible, to disembark passengers at an unscheduled stop).
OTOH as ILT has said if you divert to a nearby alternate (e.g. different airport to planned destination, but serving the same city) the passengers may well be disembarked and taken overland to the destination airport, but even that sort of seemingly sensible plan can be over-ruled by the authorities.