Technical writeups — what I'm working on, math I'm reading and research projects.
Scaling the Tree: Context Parallelism in ART
Dense attention, sparse MLA, and recurrent state across GPUs.
2026 · ART / Megatron
Prefix Tree Packing in ART
A radix tree over a training batch and the bin-packing problem.