Yep, I did something similar a few months ago with the flap. Neither of us super current, early morning, distracted by an ATC call.
Confirmation bias convinced us both they were up with the checklist, a moment later during a moment of quiet on the radio, good look around, there they were, still at take off position. Fortunately, no overspeed, raised them up... and took things carefully from then on.