What Is an LLM?

What this page will cover

• The core idea: given some text, predict the most likely next token
• Generation = predicting one token, appending it, and repeating
• Why such a simple objective produces surprisingly capable behavior
• What an LLM is not: a database, a search engine, or a program with memory