RedPajama v2 Open Dataset with 30T Tokens for Training LLMs

Submitted ⁨⁨1⁩ ⁨year⁩ ago⁩ by ⁨bot@lemmy.smeargle.fans [bot]⁩ to ⁨hackernews@lemmy.smeargle.fans⁩

https://together.ai/blog/redpajama-data-v2