You don't have to own it. You do have to be insured or it would be an illegal flight. You can't log an illegal flight.
Once you have a tailwheel sign off you are free to fly a spitfire if you can find some one daft enough to lend you one and insure you.
However although that may be legal it would certainly be a foolish thing to do.