24.
Cross-node KV-cache reuse for agentic rollouts
Cross-node prefix-cache reuse in vLLM via Mooncake Store makes agent rollouts cheaper by sharing reused context across distributed training nodes
@m_sirovatka on Backlist
1 appearance on the backlist front page in the last 30 days.