This is an actual thing. It even has a fancy name. Geophagia is nearly universal around the world in tribal and traditional rural societies.