K2-Horizon: A Frontier Fleet of Open Source Language Models 21 November 2026·8 mins Machine Learning Paper Notes Machine-Learning Arxiv Llm Open-Source Mixture-of-Experts Pretraining Llm360
CompCert4Lean: Porting a Verified C Compiler to Lean in Six Weeks with Parallel Coding Agents 21 November 2026·9 mins Programming Languages AI Engineering Paper Notes Programming-Languages Arxiv Verified-Compilation Lean Rocq Compcert Agents Formal-Methods
Unbundling Multimodal Vision Encoding 14 November 2026·10 mins Machine Learning Paper Notes Machine-Learning Arxiv Multimodal Vision-Language-Models Vision-Encoder Scaling-Laws Architecture
Raven: Towards Unified File Management for Data Lakehouse Systems 14 November 2026·12 mins Databases Paper Notes Databases Arxiv Lakehouse Iceberg Delta-Lake Catalog Garbage-Collection Transactions
Hinted Scaling Laws 7 November 2026·7 mins Machine Learning Paper Notes Machine-Learning Arxiv Scaling-Laws Evaluation Benchmarks Llm
Eliminating Servers in State Machine Replication 7 November 2026·8 mins Distributed Systems Databases Paper Notes Distributed-Systems Databases Arxiv State-Machine-Replication Shared-Log Serverless Consensus Cloud-Storage
Proving and Improving the Platonic Representation Hypothesis with JEPAs 31 October 2026·13 mins Machine Learning Paper Notes Machine-Learning Arxiv Self-Supervised-Learning Jepa Representation-Learning Multimodal Lecun
MetaDB: Putting File-System Structure Back into Distributed Databases 31 October 2026·11 mins Databases Distributed Systems Paper Notes Databases Arxiv Distributed-Systems File-Systems Metadata Lsm-Tree Mvcc Raft
The End of Consensus Research? 24 October 2026·12 mins Distributed Systems AI Engineering Paper Notes Distributed-Systems Arxiv Consensus Paxos State-Machine-Replication Lean Formal-Methods Agents
A Fix for Softmax and Cross-Entropy 24 October 2026·11 mins Machine Learning Paper Notes Machine-Learning Arxiv Numerics Optimization Adam Grokking Distillation Jax
Mixture-of-Kittens: MoE Megakernel for NVL72s 3 October 2026·11 mins AI Infrastructure Distributed Systems Paper Notes Distributed-Systems Arxiv Mixture-of-Experts Gpu-Kernels Llm-Training Nvlink
Context Language Models 3 October 2026·10 mins Machine Learning AI Engineering Paper Notes Nlp Arxiv Agents Context-Management Kv-Cache Reinforcement-Learning
mold: A Massively Parallel Linker 29 August 2026·12 mins Operating Systems Paper Notes Operating-Systems Arxiv Linkers Parallelism Build-Systems Elf
LeVJEPA: Efficient & Scalable Video Pretraining without the Heuristics 29 August 2026·12 mins Machine Learning Paper Notes Machine-Learning Arxiv Self-Supervised-Learning Video Representation-Learning Jepa
Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts 22 August 2026·11 mins Machine Learning Paper Notes Machine-Learning Arxiv Mixture-of-Experts Scaling-Laws Pretraining
From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems 22 August 2026·12 mins AI Infrastructure Operating Systems Paper Notes Operating-Systems Arxiv Llm-Serving Agents Systems
Who Should Own the Expert Cache? Kernel-Managed Tiering for Trillion-Parameter MoE Inference 15 August 2026·9 mins AI Infrastructure Operating Systems Paper Notes Operating-Systems Arxiv Mixture-of-Experts Llm-Inference Page-Cache Systems
Synthetic Persona Pretraining: Alignment from Token Zero 15 August 2026·10 mins Machine Learning Paper Notes Machine-Learning Arxiv Alignment Pretraining Llm Safety
On Topology's Role in ML Training Performance 8 August 2026·9 mins AI Infrastructure Networking Paper Notes Networking Arxiv Distributed-Training Interconnect Collectives
Architectural Implications of Agentic AI Workflows 8 August 2026·8 mins AI Infrastructure AI Engineering Paper Notes Distributed-Systems Arxiv Agents Datacenter Llm-Serving