I understand your frustration, and I have experienced similar problems with an older technology called DAT or Digital Audio Tape. My first ever was a DAT Walkman TCD D3. It had a specially designed NiCD Battery. The first time it needed to be replaced, I was able to purchase one, second time I was out of luck.
It seemed that Sony wanted to let DAT die as quickly as possible to replace everything with MiniDisc in the late 90s. Some older players cannot be repaired anymore due to the lack of parts (one unit being less than 10 years old). Shame, but I won't let Sony take away my DAT units, no matter what the latest technology is.
Should all hope fail, there's always TASCAM