The concept of whiteness comes from the Spanish inquisition after the fall of Grenada. Being fair skinned was a way of proving without a doubt that you weren't a jew or a muslim.
My guess is we'd start dividing up amongst religious heritage again. Mormons vs. Evangelicals Vs. Protestants Vs. Catholics Vs. The Real Christians