Post by @rajeevk02642739 • Hey

High-quality pretraining sets like RedPajama are a key ingredient in democratizing access to LLMs. Here is a brief exploration of what an LLM trained on R