You can fly PIC with just a medical/student pilot certificate, however you'd have to be solo, every cross country flight would have to be endorsed by an instructor, and you'd have to have training first.
It's a lot of limitations given the ease of picking up a based-on FAA cert. You'll have more fun if you can fly with the friends you meet, etc.