63.
Introducing EAGLE 3.1 — a major step forward in speculative decoding robustness, efficiency, and deployability. F… (x.com)
Introducing EAGLE 3.1 — a major step forward in speculative decoding robustness, efficiency, and deployability. From the EAGLE team @hongyangzh , in collaboration with vLLM @vllm_project and TorchSpec teams. > FC norm + post-norm archit