Velocity
This Week's Stories
Moonshot AI

Moonshot AI

AI · Open-Source · Foundation Models

Launch

Moonshot AI open-sources Kimi K3, a 2.8T-parameter MoE model

July 27, 2026

Only 104 billion of its parameters activate per query, showing the frontier race now rewards efficient sparsity over raw size.

  • Moonshot AI published full open weights for Kimi K3 on Hugging Face at 00:00 UTC on July 27, 2026, calling it the world's first open 3-trillion-parameter-class model.
  • Moonshot AI is a Chinese AI lab whose Kimi models compete with OpenAI, Anthropic and Google on frontier coding, reasoning and agentic tasks.
  • Kimi K3 is a mixture-of-experts model with 2.8T total parameters but only 104B active per token, drawn from 896 experts with 16 selected plus 2 shared.
  • It uses new Kimi Delta Attention and a Stable LatentMoE framework that Moonshot claims delivers roughly 2.5x more intelligence per unit of compute than Kimi K2, alongside a 1-million-token context window and native text/image/video understanding.
  • The full weights span roughly 1.4-1.63TB in MXFP4 quantization, requiring around 8 H100 GPUs or 2TB+ of VRAM to self-host.
  • K3 first launched via Kimi.com and the Kimi API on July 17, 2026, and traffic exceeded Moonshot's expectations, prompting it to pause new consumer subscriptions before the weights followed.
  • Benchmarks put K3 fourth on Artificial Analysis's Intelligence Index at 57 but first on Arena's Frontend Code evaluation at 1,679, ahead of Claude Fable 5.
  • By open-sourcing a frontier-tier model plus its attention kernels and MoE infrastructure, Moonshot narrows the gap between closed and open AI and pressures hosted API pricing across the industry.

Get the app

Stay Ahead With Velocity

Deep company profiles, investor context, and every original source behind this story — plus the next one, the moment it breaks.

Download on the App StoreGet it on Google Play

More This Week

View All →