How do we teach LLMs to learn what they can forget ? A technical break down of the Self-Pruned KV Attention mecha…
How do we teach LLMs to learn what they can forget ? A technical break down of the Self-Pruned KV Attention mechanism with fun ML techniques
The SP-KV mechanism works by projecting a token's hidden state into a sigmoid to get a scalar "fu
How it ranks: Backlist reads my Twitter/X timeline, scores every tweet for substance with an LLM rubric (not engagement), and publishes the daily top picks with a one-line takeaway. Curated by Surya Dantuluri.