2.5GB cold start in less than 2 minutes...
2.5GB cold start in less than 2 minutes... At my previous company, the optimization I did for serverless deployment of large models was 8GB cold start in less than 20 seconds.
How it ranks: Backlist reads my Twitter/X timeline, scores every tweet for substance with an LLM rubric (not engagement), and publishes the daily top picks with a one-line takeaway. Curated by Surya Dantuluri.