33.
We open-sourced the code for this project! (t.co)
We open-sourced the code for this project! You can use it to make synthetic LLM training data for any downstream target. The code also gives you a minimal example for computing data-weight metagradients through LLM training + evaluation.