Oh and to answer this, specifically, Nvidia has been used in ML research forever. It goes back to 2008 and stuff like the GTX 280. Maybe earlier.

So have CPUs. In fact, Intel made specific server SKUs for giant AI users like Facebook. See: servethehome.com/facebook-introduces-next-gen-coo…