[ Disclaimer: I am not a pilot or ATC ]
Surely, if the circumstances described by NoD, or others, apply, the pilot should respond "Unable" and hopefully add "due [reason]" as soon as possible, to give the controller an opportunity to come up with a new plan, rather than silently disregarding, and making him and everyone else guess... ?
