If you go back far enough you'd get to Pangia, a supercontinent, where everyone "shared" the same piece of land. So no one and everyone has claim to all lands now. In reality, who owns what when is purely dependent on who is strong enough to own it at that point in time.