Quiz -- How LLMs Work

Test your knowledge from this module! Answer the following five questions.

1. What is a token?

2. Why are 'dog' and 'cat' close together in embedding space?

3. What does the attention mechanism do?

4. Your LLM has a context window of 100,000 tokens. Your document has 120,000 tokens. What happens?

5. You need an exact, consistent answer for a business report. Which temperature do you choose?