Most companies expect you to start on Monday, but once you leave they want you to respect their notice period.
If they canīt accept that you have a contract with your current employer and that you respect that contract and the notice period same as you will respect their contract, then it might just be the wrong company.