Models, tokens and context
16 topics- Probabilistic model behaviorGuide
6 min - Model claim vs runtime factGuide
6 min - TokenizationGuide
5 min - Next-token generationGuide
6 min - Sampling controlsGuide
6 min - Context windowGuide
6 min - Model capability envelopeGuide
6 min - Latency and throughput basicsGuide
7 min - Attention budgetAttention is a budget, not a bagGuide
7 min - Relevance over raw volumeGuide
5 min - Sequence ordering mattersConcept · Guide expanding
- Context versus memoryContext is not memoryGuide
6 min - Embeddings and semantic spaceEmbeddings as semantic coordinatesGuide
7 min - Vector similarity is a retrieval signalSimilarity is not relevanceGuide
6 min - Multimodal representationGuide
7 min - Ground claims in the source modalityConcept · Guide expanding