Yes the Albacore didn't offer a vast improvement in performance and the crews didn't like them. In my youth I knew someone who had flown both in action in WW2 and he was adamant that he , and his squadron, all preferred the Swordfish partly because it was apparently an easier aircraft to fly - the Albacore needed constant attention whereas (as those of us have seen in air displays) a Swordfish will fly cheerfully straight and level with no one at the controls.