It certainly has more to do with the conditions than fuel temp and quantity. If you are uplifting any quantity of fuel the outer tanks will have the cold soaked fuel moved out of them by the refuelling process.
The fuel enters the system through bottom of the outer tanks and the fuel already there "spills" over into the inner tanks so the outers will have fresh fuel in them by the end.
Still doesn't help that much if the uplifted fuel is cold and it is a cold day but in a normal environment the frost on top of the outer tanks seems to go pretty quickly after refuelling.
If the mains still have a lot of cold fuel in them that is more of a problem and often getting de-iced or waiting for the ice to melt is all you can do.