Hear, hear!
I think your attitude and decision reflect well on your approach to flight safety.
One of the major threats to safety in private flying is time pressure. Imagine if you had had passengers with you as well, or had arranged to meet friends at the destination.
As sharpend said, try to introduce new factors gradually and always allow plenty of time for preparation and unforeseen delays. I’ve been flying for 46 years, so not quite as experienced as sharpend, but like him/her I am cautious and like you I have cancelled trips when something didn’t feel right.
Good luck with your next flight!