Where the Data Comes From

What this page will cover

Common sources: web crawls (e.g. Common Crawl), code repositories, books, papers, forums
Scale: trillions of tokens, and what that means in practical terms
Licensed vs. public vs. synthetic data