Outside of the ATZ there is nothing illegal regarding not calling. However, if one was operating inside a MATZ without talking to the "owners" & something went wrong, at the very least airmanship would likely be called into question. At the worst, that hoary old chestnut "duty of care"?
I personally don't see the problem with calling - it doesn't cost anything!
ap