I would be more concerned if you weren't nervous.
This is an entirely natural reaction.
Your confidence has taken a beating from your instructor which was probably frustration on their part, as they will feel it reflects badly on them to send a student for test who then folds.
Perhaps you weren't ready.
Whatever you do, don't give up. You've already acheived so much more than 1st solo which I think is the ultimate test of having the right stuff. Many trainee pilots bumble around, putting off the inevitable and eventually give up without going solo. Those are the ones who aren't cut out for flying.
Best of luck.