This really all depends on your cabin crew. If properly trained and instilled with the 'silent aircraft' rules at crucial times, yes, I would probably stop up to a reasonable speed, say 80kts, on receipt of a call on the basis that they would not have called unless it was important. Better safe than sorry? Even more so if your company has a system for indicating an 'emergency' such as 3 or 4 chimes.