I thought it was more like 10-20GB to start out with a usable (but somewhat stupid) model.

Are you confusing the size of the dataset with the size of the model?