Flying with a known brake failure is just taking another unneccesary risk - I wouldn't do it. Besides, break check is on the checklist of the airplanes I'm flying.
Finally a lot of modern planes such as Cirri & Diamonds don't have nose wheel steering, and during slow taxi / RPMs the rudder is sometimes ineffective for steering.