11.
Low-rank directions across checkpoints
Finding a stable low-rank direction across checkpoints hints that model merging is only one piece of a bigger geometry
@Laz4rz on Backlist
5 appearances on the backlist front page in the last 30 days.
37.
Nvm, did a whoopsie and was sampling at 1/4 generation length, which is a good sign tbh cause it means you can ge…
Nvm, did a whoopsie and was sampling at 1/4 generation length, which is a good sign tbh cause it means you can generate 4 tokens at a time at some ~70% accuracy
31.
Almost forgot how accurate these lyrics are with both Alexander Wang and New slaves
Almost forgot how accurate these lyrics are with both Alexander Wang and New slaves
50.
Friendly reminder that DeepMind just started hiring FDEs
Friendly reminder that DeepMind just started hiring FDEs
86.
This is so ironic, cause I’m pretty sure they increasingly feel like (at least in CS adjacent fields) joining a f…
This is so ironic, cause I’m pretty sure they increasingly feel like (at least in CS adjacent fields) joining a frontier lab is their only chance to do frontier (pun) research again