Frank Borman (test pilot, engineer, astronaut, commander of the first lunar orbital mission) relates his autobiography that he once forgot to raise the gear on a test flight. And only noticed some time into the flight.
If it can happen to him, it can happen to anyone!
(Granted, only one pair of eyes in the cockpit, but still)