@ChachraSahil on Backlist

2 appearances on the backlist front page in the last 30 days.

37.

Quantized JetBrains Mellum2-12B-A2.5B-Thinking to MXFP4 for Apple Silicon.

Quantized JetBrains Mellum2-12B-A2.5B-Thinking to MXFP4 for Apple Silicon. 12B MoE / 2.5B active, fits in 6.2 GB on disk and 7 GB peak memory. On M5 Pro: - Decode 130 tok/s - MATH-500 80% - HumanEval 93% - MMLU 90% Needs the open mlx-lm

by @ChachraSahil (Sahil Chachra) · backlist 2026-06-03 · rubric 84.0

43.

Quantized JetBrains Mellum2-12B-A2.5B-Thinking to OptiQ 5bpw mixed-precision for Apple Silicon.

Quantized JetBrains Mellum2-12B-A2.5B-Thinking to OptiQ 5bpw mixed-precision for Apple Silicon. 12B MoE / 2.5B active, 3/4/6/8-bit per layer (KL-sensitivity allocated). 12 GB on disk, 13 GB peak memory. On M5 Pro: - Decode 89 tok/s - MATH

by @ChachraSahil (Sahil Chachra) · backlist 2026-06-03 · rubric 82.0