K2-Horizon: A Frontier Fleet of Open Source Language Models 21 November 2026·8 mins Machine Learning Paper Notes Machine-Learning Arxiv Llm Open-Source Mixture-of-Experts Pretraining Llm360
Mixture-of-Kittens: MoE Megakernel for NVL72s 3 October 2026·11 mins AI Infrastructure Distributed Systems Paper Notes Distributed-Systems Arxiv Mixture-of-Experts Gpu-Kernels Llm-Training Nvlink
Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts 22 August 2026·11 mins Machine Learning Paper Notes Machine-Learning Arxiv Mixture-of-Experts Scaling-Laws Pretraining
Who Should Own the Expert Cache? Kernel-Managed Tiering for Trillion-Parameter MoE Inference 15 August 2026·9 mins AI Infrastructure Operating Systems Paper Notes Operating-Systems Arxiv Mixture-of-Experts Llm-Inference Page-Cache Systems
Incast-Free MoE Rate-Based Scheduling 1 August 2026·10 mins AI Infrastructure Networking Paper Notes Networking Distributed-Systems Arxiv Mixture-of-Experts Datacenter Congestion-Control