Sparse Notes

Fourteen years on, this is still the talk that most reliably rewires how an engineer thinks about their own work. It is remembered for the live-coding demos — and those demos did seed a decade of tooling, from hot reload to Swift Playgrounds to every notebook environment you use. But the demos are the setup. The talk’s actual argument arrives in the last fifteen minutes, and it is not about programming at all....

There are perhaps a trillion active SQLite databases in the world. Roughly half the filesystem I/O on the phone in your pocket goes through it. And it is maintained by three committers. That ratio — planetary deployment, three-person team — is the actual subject of this talk. Richard Hipp, SQLite’s creator, spends 54 minutes explaining the machinery that makes it possible, and the answer is not cleverness. It is a testing regime borrowed wholesale from the avionics industry, plus a willingness to redesign the product itself so it can be tested at all....

Stanford’s CS329A is one of the few graduate courses aimed squarely at the thing practitioners are actually building right now: agents that improve themselves. This first lecture is the map — a compressed tour from GPT-3-era scaling laws to the agentic loop inside Claude Code, delivered by two instructors who worked on the models in question. Akanksha Chowdhery is an adjunct professor at Stanford and researcher at Reflection AI; Azalia Mirhoseini is an assistant professor in the CS department who worked on Gemini at Google DeepMind and on Claude at Anthropic....

Almost every distributed database you touch today inherited something from a single 2007 SOSP paper. Cassandra is essentially its open-source descendant; Riak, Voldemort, and a decade of “eventually consistent” architecture trace back to the same document. This Papers We Love Tokyo session — the chapter’s inaugural talk, presented by Corrina Sivak — is a rare thing: a walkthrough by someone reading it as a working engineer rather than as an authority, complete with audience interruptions, honest “this might be a gap in my understanding,” and a genuinely useful comparison of what the paper described versus what AWS actually ships today....

Weekly Paper Notes — one of the top picks from the 2026-08-01 CS paper digest. Area: Systems / Networking. Authors: Evyatar Cohen, Jose Yallouz, Mark Silberstein, Isaac Keslassy (Technion); Alexander Shpiner (NVIDIA); Sylvia Ratnasamy, Isaac Keslassy (UC Berkeley) arXiv: 2607.26340 · PDF TL;DR Mixture-of-Experts models route each token to a small subset of experts, which turns every MoE layer into a highly skewed all-to-all communication phase across the GPU fabric....

Most retellings of the modern AI wave start with ChatGPT arriving out of nowhere in November 2022. Ross Taylor has a different vantage point: he shipped a competing language model two weeks earlier, watched it get torn apart in public, and spent the following four years working out exactly why. This talk is the compressed version of that education — half war story, half technical agenda for what comes after the current generation of agents....

Weekly Paper Notes — one of the top picks from the 2026-08-01 CS paper digest. Area: Operating Systems / Formal Methods. Authors: Qian Cheng, Ruize Tang, Yu Huang (Nanjing University); Saad Mohammad Rafid Pial, Yiming Su, Tianyin Xu (University of Illinois Urbana-Champaign); Emilie Ma, Finn Hackett, Ivan Beschastnikh (University of British Columbia) arXiv: 2607.25333 · PDF · Code TL;DR Formal verification of real systems has always been bottlenecked by the same thing: writing a good TLA+ specification takes a domain expert months, and the specification immediately begins drifting away from the code it describes....

Weekly Paper Notes — 🔁 Seminal Paper of the Week, 2026-08-01. Area: Operating Systems / Storage. Authors: Mendel Rosenblum, John K. Ousterhout (University of California, Berkeley) Published: ACM Transactions on Computer Systems, Vol. 10, No. 1, February 1992 (SOSP ‘91) DOI: 10.1145/146941.146943 Why this paper still matters Almost every high-performance storage system built in the last fifteen years is a log-structured file system wearing a different name. LevelDB, RocksDB, Cassandra, HBase, Kafka, every SSD’s flash translation layer, ZFS’s copy-on-write, btrfs, WiredTiger, Lucene’s segment merges — all of them convert random writes into sequential appends and then run a background process to reclaim space....

Two and a half years after the Devin demo went viral at 13% on SWE-bench, Cognition president Russell Kaplan sits down with Harrison Chase for the most candid accounting yet of what running coding agents at enterprise scale actually costs — and why the industry’s incentives are quietly pointed in the wrong direction. The central claim: a lot of the ecosystem is structurally motivated to get customers to token-max, and the bill is now coming due....

In 2014 at NeurIPS in Montreal, Ilya Sutskever, Oriol Vinyals, and Quoc Le presented “Sequence to Sequence Learning with Neural Networks” — the paper that showed encoder–decoder LSTMs could translate French to English end-to-end and, in doing so, planted the seed of the scaling hypothesis. In December 2024 the paper won the NeurIPS Test of Time Award and Sutskever came back on stage to look at that decade with 10 more years of hindsight....