abgd - in short - yes. Performance suffers because warm air is less dense so less weight of air is inducted per cycle and it can expand less and exert less pressure on teh piston. Also the reduced mass flow rate affects the mixture although this could in theory be sorted out by leaning.
The RAF used to lockwire the carb heat into hot on their chipmunks - not sure why actually, anyone?