If you've ever seen a Simplex or Isolair seeding bucket, they have what amounts to a vertical fin on the back ...in fixed wing fashion. it doesn't take the spin out at low speeds, but after you begin moving...straight as an Ottawa Politician ?? er straight as an arrow perhaps !
I suggest, bolt a fin, or even a couple of fins on the back, maybe one on each side like a Cessna 337