He did say "Yes".
The 'you might think that ...' formula comes from Francis Urquhart (F.U. - Geddit?) in the drama "House of Cards".
It's a bit of a wittier way of saying yes in such circumstances: CDS asks for bigger Defence Vote, Bears Sh1t in Woods, Pope Heidbutts Runway - take your pick.