Beardy
I assume you are not an airline pilot. If you were you would know that it does 'feel' very different when you change seats. The truth is that some people find it easier than others but most pilots would acknowledge that the act of flying from a different seat is initially quite hard work. It uses up a lot of capacity when normally the act of flying is a 'motor skill' - ie learnt behaviour you don't have to think about. I have no worries about the CRM aspects of this and will actively enjoy flying with guys who I do not normally get to work with.
The simple answer would be to employ the right number of FOs!