Of course, they have not forgotten and Nephi knows it. However, Laman and Lemuel were somehow able to subordinate even such a remarkable experience to their preferred worldview. Since Nephi’s worldview was so drastically different, it makes as much sense to him that they have forgotten it as that they could move on from it unchanged.