My experience of flight in A320 with gear down later than the normal retraction is of a very noisy flight deck. It would be impossible not to notice. I ferried one ‘gear down’ for over one hour and was pleased to eventually land.
Secondly attempting to retract close to retraction speed limit is unlikely to be successful, or a least a slow procedure.