A living collection of experiments, useful systems, and honest notes from the space between research and production.https://akilesh.pages.dev/enhttps://akilesh.pages.dev/writing/architechural-masterclass-in-kimi-k3/https://akilesh.pages.dev/writing/architechural-masterclass-in-kimi-k3/A 2.8T parameter model is impressive!! But what interested me more was, how do you even run this thing? This is my small attempt at unpacking the architecture choices that make Kimi K3 actually survive in production.Thu, 20 Aug 2026 00:00:00 GMTField Noteshttps://akilesh.pages.dev/writing/what-a-benchmark-cannot-tell-you/https://akilesh.pages.dev/writing/what-a-benchmark-cannot-tell-you/On the gap between a passing evaluation and a useful product.Thu, 06 Aug 2026 00:00:00 GMTResearchField Noteshttps://akilesh.pages.dev/writing/smallest-version-that-teaches/https://akilesh.pages.dev/writing/smallest-version-that-teaches/A practical way to separate an experiment from a disguised production system.Tue, 28 Jul 2026 00:00:00 GMTBuildsExperimentsField Noteshttps://akilesh.pages.dev/writing/cache-poisoning/https://akilesh.pages.dev/writing/cache-poisoning/Yo!! A quick note before we start. I have yapped a lot about prompt caching in Part 1 , how it works, what cache hits and misses actually mean, and how to improve cache hit rates without making your API bill shoot the sky.Tue, 23 Jun 2026 00:00:00 GMTResearchBuildshttps://akilesh.pages.dev/writing/prompt-caching/https://akilesh.pages.dev/writing/prompt-caching/Okay so real talk before we start….Tue, 09 Jun 2026 00:00:00 GMTResearchFuture Thinkinghttps://akilesh.pages.dev/writing/ai-does-multiplication-underneath-so-why-did-older-models-break-at-school-maths/https://akilesh.pages.dev/writing/ai-does-multiplication-underneath-so-why-did-older-models-break-at-school-maths/Like anyone who got pulled into the AI wave, I went through the whole thing. The amazement phase, the over reliance phase, the okay this thing just hallucinated phase.., and then the slow ohh okay I think I am starting to get what this actuTue, 19 May 2026 00:00:00 GMTResearchBuildshttps://akilesh.pages.dev/writing/the-smallest-thing-in-pytorch-opens-half-the-gpu-stack/https://akilesh.pages.dev/writing/the-smallest-thing-in-pytorch-opens-half-the-gpu-stack/We are living in a time when AI systems are introduced with the kind of language people used to reserve for moon missions.Mon, 30 Mar 2026 00:00:00 GMTResearchBuildshttps://akilesh.pages.dev/writing/what-happens-when-you-put-n-billion-weights-in-your-ram/https://akilesh.pages.dev/writing/what-happens-when-you-put-n-billion-weights-in-your-ram/I was in full vibe-coding mode with Headphones on. Letting Copilot autocomplete half my thoughts. Prompt here, tab there. Confidence at an all-time high. It honestly felt like I had rented extra IQ from the cloud ( having this kind of feelFri, 27 Feb 2026 00:00:00 GMTResearchBuildshttps://akilesh.pages.dev/writing/reading-minds-is-the-new-logging/https://akilesh.pages.dev/writing/reading-minds-is-the-new-logging/We are in that phase of software engineering where we churn out code at an alarming speed. You open an AI-powered IDE, type a sentence ( technically a prompt ) that sounds more like a thought than a specification, and suddenly, there are huThu, 22 Jan 2026 00:00:00 GMTResearchFuture Thinkinghttps://akilesh.pages.dev/writing/the-physics-of-prompting-why-words-dont-matter-but-structure-does/https://akilesh.pages.dev/writing/the-physics-of-prompting-why-words-dont-matter-but-structure-does/For the past few months, I’ve basically been living inside this sacred AI vibing + building multi agent systems + prompting zone. You know that phase where your YouTube is full of ‘how to prompt better’ videos, your tabs are full of blog poSat, 06 Dec 2025 00:00:00 GMTResearchFuture Thinkinghttps://akilesh.pages.dev/writing/catastrophic-forgetting-the-architecture-of-becoming-human/https://akilesh.pages.dev/writing/catastrophic-forgetting-the-architecture-of-becoming-human/I lost something this week and I still don’t know how to say it. Not my car, not a memory. Worse than that. I lost how I think….Tue, 25 Nov 2025 00:00:00 GMTResearchFuture Thinkinghttps://akilesh.pages.dev/writing/latency-diet-for-llms-cutting-millisecond-fat-without-losing-iq/https://akilesh.pages.dev/writing/latency-diet-for-llms-cutting-millisecond-fat-without-losing-iq/When I first started building my own model ( a language model for my experimental need ), I went through a lot of videos and built it from scratch. While doing so I noticed something interesting: Speed feels like intelligence. A model thatMon, 13 Oct 2025 00:00:00 GMTResearchBuilds