Mistake #1.
You assumed that TL App do things for a reason. I have been trying to "understand" them for about 12 years now - flying everything from VFR singles to turbo prop RPT. They still manage to surprise me.
You MUST NOT try to interpret TL App, or Tower for that matter.
Mistake #2
You accepted a code when departing IFL. The only reason they gave it to you is so that if you bust their CTA they can send your details off to the enemy, and have you pinged (this is sometime misinterpreted as "they were just being helpfull").
Never give yourself up when VFR - you only need to make CTAF calls.
Mistake #3
You were doing too many things correctly whilst flying VFR. This confuses controllers and makes them think/wish you were IFR. This VFR / IFR conflict in their heads often causes them to do weird things.
Solution
Fly everywhere no higher than 1500 AGL - preferably 500 except in built up areas of course.
Mumble all radio communications.
Do not respond to ATC when OCTA unless of course you want to go into CTA.
If the radio annoys you - turn it off, after all it is only there to disrupt what would otherwise be an enjoyable flight.
You are now part way into joining Cecil's Airforce, a whole world of care free aviation awaits you.