A history of activation checkpointing APIs in PyTorch

Activation checkpointing is central to training large models, and its PyTorch API history exposes the tradeoffs between memory, recomputation, and usability

A thread about the history and internal implementation details of activation checkpointing APIs in PyTorch.
Ranked #15 on backlist 2026-05-12 (12 May 2026 UTC) · by (Edward Z. Yang) ·

How it ranks: Backlist reads my Twitter/X timeline, scores every tweet for substance with an LLM rubric (not engagement), and publishes the daily top picks with a one-line takeaway. Curated by Surya Dantuluri.