Large Language Models (LLMs)

A large language model (LLM) is a deep neural network trained to continue text. Given the words so far, it predicts the next token. Scaled up on a huge corpus, that skill becomes writing, summarizing, translating, and answering questions.

Tokens, context, and parameters

TermMeaning
TokenA chunk of text the model reads or writes, often a word or part of a word
Context windowHow much text the model can see at once
ParametersThe learned weights. More parameters can mean more capacity, not automatically more accuracy
TemperatureHow much variety to allow. Lower is more stable; higher is more varied

What training does

  • Pre-training. The model reads a very large public corpus and learns language, facts, and patterns by predicting the next token.
  • Instruction tuning. Further examples teach it to follow questions and requests, not only to continue a paragraph.
  • Preference tuning. Human rankings teach it which answers people prefer.

What an LLM does not do by itself

It does not look up your private files unless you connect them. It does not guarantee that a number, a citation, or a policy quote is correct. It produces the most plausible continuation of the prompt. For work that must be sourced, pair it with retrieval or with a human check.

A practical example

A relationship manager pastes meeting notes and asks for a follow-up email with three action items. The model drafts the email in seconds. The manager corrects the client name, the amount, and the date before sending.

What to remember

  • An LLM predicts the next token. Useful behavior comes from scale and later tuning.
  • The context window is the model’s working memory for that request.
  • Treat unsupported facts as drafts until they are checked.