66.
CMU Advanced NLP Lecture 9: Decoding Algorithms
CMU Advanced NLP Lecture 9: Decoding Algorithms This lecture explains a key aspect of generative LLMs: The model learns a probability distribution, but useful generation still depends on how we decode from that distribution. Greedy deco