PegaFlow: external KV cache for vLLM

Persisting KV cache outside vLLM restarts can reduce wasted prefill work and make long-context serving more durable

KV cache shouldn't disappear every time vLLM restarts. With @novita_labs , we're sharing PegaFlow — a production-grade external KV cache service that plugs into vLLM through the external KV connector interface. PegaFlow runs as a standalo