The trim isn't a problem if you're aware of it.
Grasp the wheel firmly, press the button, then a half second of trim and you're back in business.
Bear in mind that even though the runway may be man land, and you are doing a cat one approach with a cat1 decision height, you may be able to leave the a/p connected to a later radio height.
That few seconds extra after seeing the lights and before going manual can make all the difference to the landing as the A/p tends to track nicely down the middle on calm claggy days, giving you a chance to build up a better visual perspective.
I've seen too many people see the lights then disconnect and instinctively duck under for a better view, only to find the ground coming up to meet them.