According to Wikipedia:
The Albacore remained less popular than the Swordfish, as it was less manoeuvrable, with the controls being too heavy for a pilot to take much evasive action after dropping a torpedo
This apparently is based on info in Francis K Mason's book
The British Bomber Since 1914. Not one of the few Putnam books I have sadly...