As has been said, don't lose sleep over which university your degree comes from - so long as your course is accredited.
If, however, you are already frustrated with your current place after only a year there, don't underestimate how much more frustrated you could get in the next 2 or 3 years, and how much that could sap your will to work as hard as you should.
Having a year setback is quite expensive, but if you can match it with being more satisfied with your surroundings and achievements it could be worth it.