The problem is that if we do what the "average voter" wants we'd be out of Iraq and Afghanistan in a week and we'd be happy for about a year. Then we'd be in the sh!t, because it's not a nation or a small group of people we are fighting against, it's an ideology, a twisting of a religion, a way of thinking which is entirely alien to and wants to end our way of thinking. They won't give up because we leave their countries - they'll come to ours, just as they did on 9 Sept 2001.
I couldn't have put it better... That is entirely the issue today. No-one did anyone any particular harm prior to 1992 when the first WTC attack took place. Yeah, yeah... So they don't like our culture... as an aside, they don't seem to have much problem coming to the west when they want things though... But nothing was ever done that needed to have anyone killed over. Christianity, (and therefore, the West), has always been the bugbear of the Muslims - most have learned to live with it... Others not... and those are the ones that are intent on the destruction of us and our way of life.
Unfortunately, they don't really care how they do it and how much it hurts them to do it. There are some that would be very happy to be the only remaining human alive in a nuclear winter simply so he can say "We won - Allah is great"...

It is for that very reason that those who think like that have to be stopped
before they have weapons that kill vast numbers of people - because they will use them in the belief that they are doing "gods will"... and we can't fight an invisible entity.