Clearedtoroll
I don't think you are in a minority, or if you are, it's a big one. There are huge numbers in the business who think just as you do. Whether you get the Services to do it, or invent the Government Flying Service to run all the aircraft currently operated by or on behalf of at least 8 agencies (treating police as 1 and not 54 or however many Forces we have) on non-military Government tasks, there are economies of scale out there for the taking.
While you're at it, how about the Government Boating Service for the 11+ agencies that operate floating things?
Sven