Sampling & the Context Window

What this page will cover

Probability distribution over the next token
Temperature and sampling
The context window: the model’s entire working memory
Retrieval (RAG): chunking documents and pulling relevant pieces into context