Couple of thought's
Have you in fact got icing almost immediately on startup.? So first application of Carb Heat clears it instantly and the revs climb?
Or is there a choke effect when selecting the other air source? Might this richen (?) the mixture relatively causing the increase assisted by the fact it hasn't warmed up?
Or maybe someone who knows about engines should answer!
Sir George Cayley