So by this argument, we should just go defeat Israel and give the land back to the Palestinians and no one should have anything negative to say about it right?

Yes, that is correct.

Land ownership is determined by your ability to defend it. If you can get a coalition to take down Israel, the land is yours to do whatever you want with it. That is how it works, if you want land, have big guns or big friends.