And the big problem on relying on IR sensors is that the picture is massively degraded in mist, fog or heavy rain and can also be poor in periods of thermal crossover where everything is emitting radiation of the same frequency - so without contrast there is no picture.
You would also need all your flight symbology to be displayed on the EVS screen if you were to stand any chance of controlling the helicopter by flying a TV screen picture.