While many problems can be researched on a small scale, native long-context isn't one of them. Tackling it with l…

While many problems can be researched on a small scale, native long-context isn't one of them. Tackling it with limited compute and small datasets just gives you false signals about what actually works. You need scaling experiments and infr