In Alma 35:10 it says that the Zoramites "began to mix with the Lamanites." According to John Sorenson, this phrase implies that there wasn't a very big distance between the two peoples.
