38.
Two new tokenisation methods hitting arXiv today, both based on linear programming, and both with SOTA results! C… (t.co)
Two new tokenisation methods hitting arXiv today, both based on linear programming, and both with SOTA results! Check them out! Tokenisation via Convex Relaxations: https:// arxiv.org/abs/2605.22821 Tokenization with Split Trees: https:/