Not familiar with the style of the RTOW chart, but is it maybe a runway and flap-specific one where the temperature increases up the page and the wind component goes across the page? Then for an increase in temperature, the RTOW would decrease, leading to the decrease of V speeds that you mention.