It’s been done already, just not by Google:

huggingface.co/ykilcher/gpt-4chan/

archive.org/details/gpt4chan_model_float16