Posts

Posts in 2026

• 26 Apr 2026
  DeltaNet: Improved Linear Attention with Delta Rule
• 23 Apr 2026
  Mathematical Formulation of Linear Attention
• 12 Apr 2026
  Introduction to Rotary Positional Embedding
• 8 Apr 2026
  Experiment: Drawing Roofline for Nemotron-3 Nano
• 7 Apr 2026
  Multihead Latent Attention (MLA)
• 17 Mar 2026
  Mamba2: Transformers are SSMs
• 12 Mar 2026
  Ring All Reduce Algorithm
• 12 Mar 2026
  Triton Kernel Study
• 12 Mar 2026
  Address Sanitizer
• 20 Feb 2026
  HW Compatible Quantization