Where I fly, brakes are very important, and absolutely necessary. However, no matter what you fly, the brakes are installed for a reason. If you operate the airplane properly, you should seldom need to use the brakes, especially during ground operations. Judicious use of power and planning means that you don't roar up to anything and rely upon brakes; you slow down, and use power to move, not brakes to slow or stop.
There may be times when you need brakes (certainly often the case when making a turn in a conventional gear airplane), and it's hard to do a run-up while holding short or holding in position on the runway, without brakes. You may find that you need brakes; simply because a normal taxi may not require them doesn't mean you won't need them.
A couple of years ago a wheel failed while I was landing in a light twin. The airplane very much wanted to turn left as the wheel attempted to leave the airplane. Full right rudder didn't help much; it required nearly full right brake to hold the airplane on the runway. Again, you never know when you'll need it. You made the correct decision to return to the hangar and get help.