Loose, my version of CC which is 4.16, offers a list at the very start of its operation that allows the placement or removal of ticks in two sets of tabs in a left hand window.
To preserve things that seem to be generally relevant, go to the 'Windows' tab and in the Windows Explorer section untick Recent Documents, Run and Other Explorer MRUs.
Then go to the 'Applications' tab and untick what for me is Office 2007 - and any other of the programs listed if you choose.
Whether or not using CCleaner is really necessary I am not sure but I have not suffered any serious grief - so far - from running it occasionally...
Maybe you need to update the version you are using...
cheers
jg