Test your knowledge from this module! Answer the following five questions.
Question · Self-check
1. What is a token?
Think about how an LLM processes text internally.
Question · Self-check
2. Why are 'dog' and 'cat' close together in embedding space?
Think about the city analogy: which words live in the same neighborhood?
Question · Self-check
3. What does the attention mechanism do?
Think about the conference room analogy.
Question · Self-check
4. Your LLM has a context window of 100,000 tokens. Your document has 120,000 tokens. What happens?
Think about the desk: what happens when there is more material than fits on it?
Question · Self-check
5. You need an exact, consistent answer for a business report. Which temperature do you choose?
Business reports need precision, not creativity.