Ball's BlogBall's Bloghttps://ball-blog-renew.vercel.app/DeltaNet: Improved Linear Attention with Delta Rulehttps://ball-blog-renew.vercel.app/posts/ai/delta-net/https://ball-blog-renew.vercel.app/posts/ai/delta-net/This post introduces DeltaNet, an improved linear attention mechanism with the delta rule.Sun, 26 Apr 2026 00:00:00 GMTMathematical Formulation of Linear Attentionhttps://ball-blog-renew.vercel.app/posts/ai/linear-attention/https://ball-blog-renew.vercel.app/posts/ai/linear-attention/This article explores the mathematical formulation of linear attention, a technique used in machine learning to improve softmax attention mechanisms. We will discuss how linear attention works, its advantages, and its applications in various AI models.Thu, 23 Apr 2026 00:00:00 GMTMultihead Latent Attention (MLA)https://ball-blog-renew.vercel.app/posts/ai/mla/https://ball-blog-renew.vercel.app/posts/ai/mla/This post introduces MLA technique that was introduced in Deepseek-v2 technical report.Tue, 07 Apr 2026 00:00:00 GMTIntroduction to Rotary Positional Embeddinghttps://ball-blog-renew.vercel.app/posts/ai/rotary-positional-embedding/https://ball-blog-renew.vercel.app/posts/ai/rotary-positional-embedding/This post introduces the concept of Rotary Positional Embedding and its implementation in transformer models.Sun, 12 Apr 2026 00:00:00 GMTTEKGG, Two-trial tExt Knowledge Graph Generationhttps://ball-blog-renew.vercel.app/posts/ai/tekgg/https://ball-blog-renew.vercel.app/posts/ai/tekgg/This post is about research project at KAIST CS471 Graph Machine Learning and MiningTue, 10 Jun 2025 00:00:00 GMTPaper Review: CacheBlendhttps://ball-blog-renew.vercel.app/posts/ai-system/cache-blend/https://ball-blog-renew.vercel.app/posts/ai-system/cache-blend/This post is about CacheBlendTue, 15 Apr 2025 00:00:00 GMTHW Compatible Quantizationhttps://ball-blog-renew.vercel.app/posts/ai-system/hw-compatible-quantization/https://ball-blog-renew.vercel.app/posts/ai-system/hw-compatible-quantization/This post explains the HW compatible quantizationFri, 20 Feb 2026 00:00:00 GMTExperiment: Drawing Roofline for Nemotron-3 Nanohttps://ball-blog-renew.vercel.app/posts/ai-system/nemotron-3-nano-roofline/https://ball-blog-renew.vercel.app/posts/ai-system/nemotron-3-nano-roofline/This post introduces experiment of drawing roofline for Nemotron-3 Nano model with Nsight Compute and vLLM.Wed, 08 Apr 2026 00:00:00 GMTBasics of Quantizationhttps://ball-blog-renew.vercel.app/posts/ai-system/quantization/https://ball-blog-renew.vercel.app/posts/ai-system/quantization/This post explains the basics of quantizationFri, 13 Jun 2025 00:00:00 GMTMamba2: Transformers are SSMshttps://ball-blog-renew.vercel.app/posts/ai/mamba2/https://ball-blog-renew.vercel.app/posts/ai/mamba2/This post is a review of the paper Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.Tue, 17 Mar 2026 00:00:00 GMTRing All Reduce Algorithmhttps://ball-blog-renew.vercel.app/posts/ai-system/ring-all-reduce/https://ball-blog-renew.vercel.app/posts/ai-system/ring-all-reduce/This post explains the Ring All Reduce AlgorithmThu, 12 Mar 2026 00:00:00 GMTTree All Reduce Algorithmhttps://ball-blog-renew.vercel.app/posts/ai-system/tree-all-reduce/https://ball-blog-renew.vercel.app/posts/ai-system/tree-all-reduce/This post explains the Tree All Reduce AlgorithmFri, 26 Dec 2025 00:00:00 GMTTriton Kernel Studyhttps://ball-blog-renew.vercel.app/posts/ai-system/triton-kernel-study/https://ball-blog-renew.vercel.app/posts/ai-system/triton-kernel-study/This post explains the Triton kernel studyThu, 12 Mar 2026 00:00:00 GMTAddress Sanitizerhttps://ball-blog-renew.vercel.app/posts/computer-system/address-sanitizer/https://ball-blog-renew.vercel.app/posts/computer-system/address-sanitizer/This post explains the Address SanitizerThu, 12 Mar 2026 00:00:00 GMT