We already had one case of altitude burst in my airline cause the captain was flirting with the cabin crew while the fo was in the toilet and read back the clearanceof a company traffic with similar call sign.
Sound like your airline needs more mature captains and/or better trained cabin crew, who should know not to distract pilots during the FD visit.
I work for an airline that has the rule and it works without any issues.