Actually, you do get a license on the spot, issued by the FAA examiner, but it's just a temporary license valid for 120 days. The final license will arrive later (I am waiting since longer than a month). The temporary one is treated as a full license, so you are allowed to take passengers, rent a plane and so on.