This idea comes up every now and then, and goes away just as often.
As you said, it would require the two countries making a common border agreement, and that's not likely.
Citizens of each country are permitted to travel freely between the two, but a common border would enable a foreign national to enter one country based on the visa issued by the other - not a situation either nation is going to enjoy.