It could be something else that's running and using too much CPU capacity.
What do you see if you bring up the Task Manager, and then sort the processes in descending order of CPU usage? If system idle isn't well over 90% virtually all the time, I'd be suspicious.
If system idle is 97% and above all the time, then drivers (as above).