Kimi K3: The First Frontier AI Model You Can Actually Own
Kimi K3 brings current frontier-level intelligence to open weights. Here is why that matters, how the architecture works, and every practical way to use it.
Part of the LLMs topic hub.
Table of Contents
I’ve talked a lot about open AI models before, and why they’re important. And in the past, open models have always lagged the leading frontier closed models (ChatGPT, Claude, Gemini, etc).
Not any more.
Moonshot AI has released a 2.8 trillion parameter model with a million-token context window, native vision, and coding-agent chops. The benchmark charts put it beside Claude Fable and GPT-5.6 Sol. And you can access the weights today.
That’s wild.
That is why this launch has people excited. For years, the strongest models lived behind a few closed APIs. K3 brings frontier-level capability into the open-weight world.
So let’s break down what Kimi K3 is, what’s the secret sauce, and how you can try it yourself. But first, what does open-weight mean and why does it matter so much?
Never Ask A Model Its Weights
A language model starts as a large mathematical structure filled with numbers. During training, the model reads vast amounts of text, code, images, and other data. Each training step adjusts those numbers slightly.
Those learned numbers are the weights, also called parameters.
The weights encode the patterns the model learned during training. Grammar, programming concepts, visual relationships, facts, styles, and problem-solving behaviours all emerge from interactions between those numbers.
When you ask a model a question, inference software loads the weights and uses them to calculate the next token. It repeats that calculation until it has produced a response.
The model therefore has several important ingredients:
- An architecture that defines how information moves through it
- Training code that teaches it
- Training data and a process for preparing that data
- Weights produced by the training process
- Inference code that loads the weights and generates outputs
- Post-training techniques that shape reasoning, tool use, and safety
A closed model keeps most of this inside the lab. You send a request to an API and receive a response. You can observe the model’s behaviour, but you cannot download the underlying intelligence.
An open-weight release gives you the trained parameters and enough code to run them.
Think of it like receiving a finished engine. You can inspect it, install it, modify parts of it, tune it for a particular job, or hire someone else to operate it. You still do not know everything about the factory that built it. You may have limited information about the raw materials, manufacturing process, failed prototypes, and quality-control decisions.
Open-source AI sets a higher bar. The Open Source Initiative’s definition requires the freedoms to use, study, modify, and share the system. It also calls for the preferred form needed to modify it, including the model parameters, training and inference code, and detailed information about the training data.
Here is the practical difference:
| Release type | What you receive | What you control |
|---|---|---|
| Closed API | Access to a hosted model | Your prompts and application code |
| Open weights | Trained parameters and inference tooling | Hosting, adaptation, versioning, and much of deployment |
| Open-source AI | Weights plus the code and data information needed to study and reproduce the system | The broadest practical and legal control |
Kimi K3 is open-weight.
Moonshot published the weights, architecture details, inference support, model configuration, and a technical report. It did not publish the complete training dataset or everything required to reproduce K3 from scratch.
That being said, the weights are the scarce artifact. Training K3 required enormous amounts of compute, data, research, and engineering. Very few organizations can create a model at this level. Once the weights exist, many more organizations can host, study, adapt, and build on them. You can download them from Hugging Face, run them on infrastructure you control, move between hosting providers, fine-tune them, and preserve the exact version you built around.
Why Does This Matter?
Last month, the US government accidentally demonstrated why.
On June 12, it placed export controls on Anthropic’s newest Fable 5 and Mythos 5 models. The order required Anthropic to block foreign nationals from accessing them, including foreign nationals working inside the United States.
Anthropic had no reliable way to verify every user’s nationality in real time, so it switched both models off for everyone.
One minute, developers had access to frontier intelligence. The next minute, they didn’t.
Software developers already understand the danger of building on a dependency they cannot control. APIs shut down. Terms of service get rewritten. Products pivot toward enterprise customers and suddenly develop an allergy to affordable plans.
AI raises the stakes because the model often contains the most valuable capability in the product.
If you build a normal application on a database, you can export the data and move to another database. If you build an AI product around a particular frontier model, switching can change the entire personality and performance of the product. Prompts behave differently. Tool calls change. Structured outputs break.
The model becomes a dependency and a behaviour layer at the same time. Kimi K3 removes that dependency.
Of course, it’s not the first open-weight model. DeepSeek-R1 was a huge moment for open reasoning models, and newer releases from GLM, Qwen, OpenAI, and Nvidia have kept closing the gap between them and frontier models. K3 crosses a more important line: it sits in the same broad capability band as the current frontier closed models on the day of release. So for the first time ever, you can have your cake and eat it too.
The political fight over open models
K3 arrived in the middle of a much larger argument.
US policymakers have been debating sanctions and restrictions aimed at increasingly capable Chinese models. Officials have accused Chinese labs of using distillation to learn from American systems and raised concerns about national security, cybersecurity, and the permanent release of powerful capabilities.
On July 24, Nvidia, Microsoft, Meta, IBM, Palantir, the Linux Foundation, and other organizations signed an industry letter defending open-weight AI. Google and OpenAI joined the broader push over the following days. The letter warned policymakers against premature restrictions that would weaken competition or push development overseas.
Nvidia then launched the Open Secure AI Alliance with companies across cloud infrastructure, cybersecurity, enterprise software, and AI research.
The alliance makes a straightforward argument. Security teams need models they can inspect, adapt, and run inside their own environments. Closed APIs can reject legitimate defensive work because a provider cannot reliably distinguish a security researcher from an attacker.
Hugging Face recently encountered exactly this problem. During an investigation into an AI-driven intrusion, closed models blocked parts of the forensic analysis. Hugging Face used an open-weight model on its own infrastructure to analyze more than 17,000 actions and contain the attack.
Concentrating frontier AI behind a few APIs creates another set of risks. A handful of companies become single points of failure. They gain enormous influence over pricing, acceptable use, data access, and which countries participate in the AI economy.
We will need rules for harmful uses of AI. Those rules should target harmful systems and actions with precision. A blanket attack on open weights would also remove the properties that make them valuable for research, security, competition, and sovereignty.
What open weights give a business
The policy debate can feel abstract, so let us bring it back to the company trying to ship a product.
Continuity
You can preserve a known model version.
Closed providers regularly update aliases, retire old models, and change behaviour. An open-weight deployment can remain frozen while you evaluate a newer version. Your production system does not wake up with a new personality because a lab completed a rollout overnight.
Provider portability
Several companies can host the same weights.
If one provider becomes expensive or unreliable, you can move to another. The serving implementation may still create differences in speed and supported features, but the underlying model remains K3.
This is a much easier migration than changing from K3 to an unrelated model family.
Data control
Open weights can run inside infrastructure you choose.
Hospitals, banks, governments, and companies handling sensitive intellectual property often have strict rules about where data travels. A self-hosted or dedicated deployment lets them keep prompts, files, and outputs inside an approved environment.
An open model does not magically solve privacy. The hosting architecture, logs, employees, network, and application still matter. It gives you the option to design those controls yourself.
I built a local AI chief of staff around the same requirement: client documents stay on hardware I control.
Customization
You can adapt weights to your domain.
Fine-tuning can teach a model specialised terminology, output formats, tool-use patterns, and behavioural preferences. LoRA adapters can make these changes without retraining trillions of parameters.
Imagine a legal research company that has spent years building a private evaluation suite. With an open model, it can train an adapter around the exact tasks where the base model struggles. The improved capability becomes an asset the company controls.
With a closed API, improvements usually live in prompts, retrieval systems, and external tools. Those are useful, but the model itself remains unchanged and owned by somebody else.
Negotiating power
Provider competition pushes down serving costs.
A closed lab owns both the model and the primary API. Open weights separate the model from the infrastructure. Cloud providers compete on latency, throughput, regions, data retention, and price.
Even companies that never self-host benefit from the option.
Sovereignty
Countries increasingly view AI as infrastructure.
They do not want their education, healthcare, defence, and public services to depend entirely on a foreign API that can be restricted during a political dispute. Open weights allow national and regional deployments, local adaptation, and operation under domestic data rules.
You can dislike the word sovereignty and still appreciate the underlying requirement: critical systems need a credible exit plan.
What is Kimi K3?
Moonshot AI is a Beijing-based AI lab founded in 2023. Its Kimi models earned a reputation for long context, coding, reasoning, and agentic work. Kimi K2, K2.5, K2.6, and K2.7 steadily pushed the open-model frontier forward.
K3 is the first model in the family to jump to a new scale.
It contains 2.8 trillion total parameters, supports up to one million tokens of context, understands text and visual inputs, and always uses a reasoning mode. Moonshot calls it the world’s first open 3T-class model.
Those numbers need translation.
Is K3 actually a frontier model?
Model launches now arrive with enough benchmark tables to wallpaper a small apartment. The exact rankings will change within weeks, and different agent harnesses can produce very different scores from the same underlying model.
We only need a few independent signals to establish where K3 sits.
Artificial Analysis gives K3 a score of 57 on its Intelligence Index. That makes it the strongest open-weight model in its current results and places it in the same neighbourhood as closed systems such as GPT-5.5 and Claude Opus 4.8.
K3 also reached the top tier of Arena’s blind React coding leaderboard, competing with newer Claude and GPT models. Artificial Analysis placed it near the top of AA-Briefcase, an evaluation built around realistic knowledge-work deliverables such as spreadsheets, presentations, analysis, and user interfaces.
Of courses, K3 does not win every evaluation. GPT-5.6 Sol and Claude Fable 5 lead several reasoning and coding tests. But still, it should be considered a frontier model.
What do 2.8 trillion parameters mean?
Imagine a company with 896 teams of specialists.
Every time a piece of information enters the model, a router chooses 16 teams that appear best suited to handle it. A programming token may activate a different mixture than a sentence about chemistry or a detail inside an image.
The whole company contains 2.8 trillion learned parameters. Each token uses about 104 billion active parameters during inference.
This design is called a Mixture of Experts, or MoE.
The word “expert” can be misleading. Moonshot did not label one expert “JavaScript” and another “Victorian poetry.” Specialisation emerges during training. Some experts learn patterns that make them useful for certain token types, concepts, languages, or stages of reasoning.
The router learns which experts to call.
A dense 2.8-trillion-parameter model would activate every parameter for every token. The compute bill would be biblical. K3 stores far more capacity than it uses during each forward pass, which makes the scale possible.
Sparse activation does not make the model small. The full checkpoint is about 1.56 TB even in its native low-precision format. Hosting still requires serious hardware and fast communication between accelerators.
What does a million-token context window mean?
The context window is the model’s working desk.
Every message, code file, document, image representation, reasoning trace, and tool result consumes space on that desk. When the context fills up, an agent has to remove information, summarise it, or start a new session.
One million tokens gives K3 an unusually large desk, on par with the current frontier models. It can hold a substantial codebase, hundreds of documents, or a long agent history in one request.
A larger context window does not guarantee perfect recall. Models can still miss a critical line buried in the middle. Irrelevant material can distract them. Old instructions can conflict with new ones. Context engineering remains important, which I cover in my guide to setting agents up for success.
The extra room becomes valuable when removing information would destroy useful detail.
What can K3 do?
K3 targets coding and end-to-end knowledge work.
Moonshot’s launch examples include:
- Building an interactive research site covering 42 years of AI chip development
- Searching thousands of web pages and original financial reports
- Analysing 391 gravitational-wave events with scientific visualisations
- Producing editable presentations, spreadsheets, and reports
- Editing a teaser video from 56 source clips
- Building applications from screenshots and screen recordings
- Working across compilers, GPU kernels, CAD, and chip-design tasks
These are Moonshot’s demonstrations, so apply the usual vendor-demo seasoning. They still show the product direction. K3 was designed to work across files, tools, images, video, code, and long histories.
The visual capability is particularly interesting for developers. A coding agent can inspect a screenshot, change the application, render the result, compare it with the reference, and repeat. I have written about this kind of verification loop in my AI coding playbook.
Now let us look at the architecture that makes the scale and context possible.
How Kimi K3 works
The United States has spent years restricting Chinese access to advanced AI chips. Current rules allow some H200 exports on a case-by-case basis, which still leaves Chinese labs with less predictable access to new Nvidia hardware than OpenAI, Anthropic, Google, or Meta.
This means Moonshot had a strong incentive to squeeze more intelligence from every unit of compute, and they’ve developed three clever techniques to do this.
Kimi Delta Attention
Standard attention allows every token to compare itself with every earlier token. This gives the model precise recall, and the cost grows quickly with the length of the input. Doubling the number of tokens creates roughly four times as many possible token relationships.
That becomes painful when the context window holds one million tokens.
Kimi Delta Attention, or KDA, is Moonshot’s attempt to get a better tradeoff between efficient memory and expressive recall. Moonshot first introduced it in Kimi Linear and then rebuilt much of K3 around it.
KDA maintains a compact state as tokens arrive. Each new token can add information to that state, preserve existing information, or selectively overwrite information that has become stale. That’s what the “delta” means here. The model learns an update rule that can correct its memory instead of endlessly accumulating new values.
Here is a simple mental model.
Suppose you are keeping notes during a meeting:
Project deadline: Friday
Owner: Maya
Deployment region: Canada
Ten minutes later, the team moves the deadline to Monday.
A crude running summary may preserve both dates and leave you with a contradiction. A delta-style memory update can locate the relevant state and replace Friday with Monday.
KDA itself predates K3, and global attention certainly predates KDA. The K3 innovation lies in scaling this hybrid across a one-million-token model and building the low-level systems required to train and serve it.
Attention Residuals
Attention Residuals are the most original architectural idea in K3.
K3 contains 93 layers. Each layer reads the output from the layer before it, transforms that information, and passes the result onward. Normal residual connections keep a running mixture of everything the earlier layers produced.
Imagine passing a document through 93 editors. Each editor receives the latest version, makes changes, and hands it to the next person. By editor 80, the original wording and the decisions made by editor 12 are buried inside one heavily revised document.
Attention Residuals give every editor access to selected earlier versions.
A later layer can retrieve information from the initial embedding, a recent group of layers, or a much earlier point in the model. It learns which earlier representations are useful for its current job and how much weight to give each one.
Normal attention searches across tokens. Attention Residuals search across the model’s depth.
This matters because making a model deeper only helps when useful information survives the journey. K3 gives later layers cleaner routes back to earlier representations, which helps a 93-layer network learn without forcing every intermediate result through one running mixture.
Moonshot developed Attention Residuals before K3 and tested the idea on smaller models. K3 takes it to 93 layers and 2.8 trillion parameters.
Stable LatentMoE
Mixture-of-Experts models have been around for years. The basic idea resembles a large consultancy.
Every request first goes to a router. The router chooses a small group of specialists for that request. A tax question may go to the tax team. A compiler problem may go to the systems engineers. The company can employ thousands of people while each job only consumes the time of a few.
K3 pushes this much further than previous open models. It has 896 routed experts and selects 16 for each token, plus two shared experts that always participate. About 1.8% of the routed experts work on any given token.
Now this creates two nasty engineering problems.
First, moving a full-size representation to 16 experts across different chips creates a lot of communication. Stable LatentMoE compresses each token into a smaller internal representation before sending it to the specialists. The shared experts keep a full-width path for general knowledge.
Second, routers develop favourites. If half the tokens choose the same experts, those chips become overloaded while others sit idle. Moonshot’s Quantile Balancing method spreads the work more evenly using the distribution of the router’s scores. Its MoonEP training system then gives every accelerator a predictable amount of expert work and communication.
Stable LatentMoE therefore gives Moonshot two efficiency gains. K3 can hold far more learned capacity than it activates for each token, and the training cluster spends less time waiting for overloaded chips.
The innovation is the combination
K3 includes plenty of other engineering: Gated Multi-head Latent Attention, low-precision weights, quantisation-aware post-training, a native vision encoder, a modified Muon optimiser, million-token reinforcement learning, and custom inference kernels.
Most of those ideas already exist in other models or earlier Kimi releases so I’m not going to go into detail here.
The big picture is:
- KDA makes million-token sequences cheaper to process.
- Attention Residuals stop useful information from getting buried across 93 layers.
- Stable LatentMoE gives the model a huge pool of knowledge while activating a small fraction for each token.
- Moonshot designed the algorithms, training system, and GPU kernels as one stack.
It’s very clever engineering and optimization. K3 gets more useful work from its compute by attacking waste across sequence length, model depth, and expert routing.
Every practical way to use Kimi K3
Open weights create more access options than a normal model launch. You can use Moonshot’s finished products, call a hosted API, route through an aggregator, bring K3 into coding tools, or deploy the weights yourself.
The right choice depends on what you are trying to learn.
| Route | Best for | Model identifier |
|---|---|---|
| Kimi.com | Chat, files, and quick testing | Select K3 in the interface |
| Kimi Work | Research and editable business deliverables | Select a K3 agent |
| Kimi Code | Repository work in a terminal | k3 or k3-256k |
| Moonshot API | Custom applications | kimi-k3 |
| Vercel AI Gateway | Production routing and provider choice | moonshotai/kimi-k3 |
| OpenRouter | Fast comparison across models | moonshotai/kimi-k3 |
| Hugging Face | Downloading and self-hosting weights | moonshotai/Kimi-K3 |
Use K3 in your browser
The fastest way to try the model is Kimi.com.
Create an account, start a new chat, and choose K3 from the model picker. You can select low, high, or max reasoning effort.
If you are new to test-time compute, my guide to reasoning AI explains why giving a model more time to think can improve difficult answers while making simple ones slower and more expensive.
The chat interface includes web search, URL fetching, image search, Python execution, memory, and file uploads. K3 can work with PDFs, Word documents, spreadsheets, images, and video.
Use this when you want to understand K3’s writing, reasoning, research, and visual abilities before connecting an API.
Use Kimi Work for knowledge work
Kimi Work wraps K3 in an environment designed for research and business deliverables. It’s basically ChatGPT Work or Claude Cowork.
It can produce editable .docx, .xlsx, .pptx, and .pdf files, along with dashboards, widgets, and interactive reports. The desktop application can also use browser and computer tools when you grant permission.
This is the best place to test the polished Kimi product experience and K3’s agentic capabilities.
If you want to understand how models become working agents, my complete guide to AI agents explains the orchestration layer in detail.
Use Kimi Code for software development
Kimi Code is Moonshot’s terminal coding agent, like Codex and Claude Code. It reads and edits files, executes commands, searches the web, uses subagents, connects to MCP servers, and iterates against test results.
Install it on macOS or Linux:
curl -fsSL https://code.kimi.com/kimi-code/install.sh | bash
Open a new shell, move into a project, and start Kimi:
cd your-project
kimi
On the first run, log in:
/login
Then choose K3:
/model
You can also run Kimi through other coding agents. The Kimi Code API supports OpenAI-compatible and Anthropic-compatible protocols, with official setup guides for Claude Code, OpenCode, and Codex.
This gives you a useful separation between the model and the agent harness. You can test K3 inside Kimi Code, Claude Code, Codex, or OpenCode and see how much the surrounding tool changes the result.
My breakdown of Claude Code’s agent harness shows how much work happens outside the model: context assembly, permissions, tools, retries, compaction, and verification.
Call the Moonshot API directly
For applications, create an API key on the Kimi API Platform and use its OpenAI-compatible endpoint.
Install the OpenAI Python client:
pip install openai
Then make a request:
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["MOONSHOT_API_KEY"],
base_url="https://api.moonshot.ai/v1",
)
response = client.chat.completions.create(
model="kimi-k3",
reasoning_effort="high",
messages=[
{
"role": "user",
"content": (
"Review this architecture proposal. Identify the three "
"highest-risk assumptions and suggest a test for each."
),
}
],
)
print(response.choices[0].message.content)
K3 always runs with thinking enabled. The reasoning_effort field accepts low, high, or max.
Use low for straightforward extraction or classification. Use high for normal engineering and analysis. Save max for problems where extra reasoning can change the answer.
Use Vercel AI Gateway
Vercel AI Gateway exposes K3 through one model identifier:
moonshotai/kimi-k3
With the Vercel AI SDK:
import { streamText } from 'ai';
const result = streamText({
model: 'moonshotai/kimi-k3',
prompt: 'Explain the failure modes in this distributed job design.',
});
for await (const chunk of result.textStream) {
process.stdout.write(chunk);
}
The gateway currently routes K3 through Moonshot AI, Fireworks, Baseten, Together AI, Novita AI, and Nebius. Provider availability changes, so check the model page before hardcoding a routing preference.
This route gives you centralised usage tracking, budgets, and provider failover. You can change the hosting provider while keeping the same model slug.
Vercel also offers moonshotai/kimi-k3-fast, currently served through Fireworks. It generates faster and charges a higher token price.
Use the normal model while evaluating quality and cost. Reach for the fast endpoint when latency becomes the bottleneck.
Use OpenRouter
OpenRouter uses the same model slug:
moonshotai/kimi-k3
Its API is OpenAI-compatible:
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "moonshotai/kimi-k3",
"messages": [
{
"role": "user",
"content": "Review this technical design and find the risky assumptions."
}
]
}'
OpenRouter is handy for model comparisons because one account gives you access to many model families. You can run the same evaluation against K3, Claude, GPT, GLM, and Qwen without creating a separate integration for each provider.
Use a hosted inference provider
You can also call K3 directly through infrastructure companies.
At launch, hosted options include:
- Fireworks AI, with serverless and dedicated deployments
- Baseten, with an OpenAI-compatible Model API and dedicated deployments
- Together AI, with serverless access
- Novita AI
- Nebius
- Moonshot’s own API
The model weights are the same. Serving stacks can vary in throughput, latency, maximum output, caching, regions, and support for visual inputs.
Run your evaluation through the provider you expect to use in production.
Download and self-host K3
The full checkpoint lives at moonshotai/Kimi-K3.
Moonshot currently recommends three inference engines:
The model card includes starter commands such as:
vllm serve "moonshotai/Kimi-K3"
The checkpoint is around 1.56 TB. Moonshot recommends supernode configurations containing 64 or more accelerators for efficient large-scale serving, although hardware vendors have demonstrated smaller high-memory configurations for basic deployment.
Self-hosting K3 makes sense for cloud providers, research labs, governments, and large enterprises with strict control requirements. Most developers should use a hosted K3 endpoint.
Open weights give you provider choice even when you never own a GPU. That is already valuable.
How to test K3 for your own work
Model evaluation works when it reflects your actual workload.
You need representative tasks, fixed acceptance criteria, equivalent tools, and a way to record total cost and human effort.
Choose four real tasks
Pick:
- A frequent task that affects your daily work
- A difficult task where your current model regularly struggles
- A long-context or visual task suited to K3
- A small task that reveals whether K3 is too slow or expensive for routine use
Use real repositories and documents. Remove secrets and customer data first.
Keep the comparison fair
Give every model:
- The same initial prompt
- The same starting files
- The same acceptance criteria
- Equivalent search, terminal, and browser tools
- A fresh session
- The same permission boundaries
- The same maximum time or spending limit
Agent harnesses complicate the comparison. Kimi Code and Claude Code have different prompts, tools, context strategies, and retry behaviour.
You can run two useful experiments:
- Compare complete products, such as Kimi Code against Claude Code
- Compare models inside the same compatible harness
The first tells you which product helps you ship. The second tells you more about the underlying model.
Test 1: repository engineering
Choose a feature or bug that touches several parts of a real application.
Use a prompt like:
Inspect this repository and implement [feature]. Identify every affected file before editing. Preserve the existing architecture and conventions. Add or update tests, run the relevant checks, and keep iterating until they pass. Avoid unrelated changes. Report the commands you ran and any assumptions you could not verify.
Record:
- Whether the agent found the correct files
- Whether its plan matched the architecture
- The number of human corrections
- Tests added and passed
- Unnecessary changes
- Time to a mergeable result
- Total tokens or credits consumed
Test 2: visual frontend implementation
K3 performed well in blind front-end evaluations, so test that strength directly.
Give it a screenshot or design mockup and an existing application:
Recreate this interface inside the existing application. Use the project’s components and design tokens. Match the reference at desktop and mobile widths. Inspect the rendered page after implementation, compare it with the reference, and fix visible differences. Check keyboard navigation and colour contrast before finishing.
Evaluate:
- Visual similarity
- Responsive behaviour
- Accessibility
- Reuse of existing components
- Code quality
- Whether the agent inspected its output
- The number of visual correction loops
A generated page can look good in a screenshot while containing a pile of absolute positioning and sadness. Read the code.
Test 3: document-heavy research
Create a small corpus containing PDFs, spreadsheets, web pages, and at least one deliberate contradiction.
Prompt:
Produce an evidence-backed report from these sources. Cite the source for every numerical claim. Reconcile conflicting information and explain which source you trust. Include a comparison table and a list of claims you could not verify. Do not use outside information unless you cite it separately.
Evaluate:
- Correct retrieval from long documents
- Source attribution
- Handling of conflicting evidence
- Numerical accuracy
- Quality of the final structure
- Unsupported claims
- Performance as context grows
This test tells you more about the million-token window than pasting a large file and asking for a summary.
Test 4: the boring task
Give K3 a small, ordinary problem:
Find the cause of this failing test and make the smallest safe fix. Run the test after the change and explain the failure in three sentences.
Measure the time and cost.
K3 can be excellent for hard tasks and irritating for simple ones. Always-on reasoning adds latency and output. A smaller or faster model may handle most daily work more efficiently.
Use a scorecard
Do not score the model while watching it work. The confident one will charm you.
Fill this out after each run:
| Measure | K3 | Current model |
|---|---|---|
| Acceptance criteria passed | ||
| Human interventions | ||
| Time to usable result | ||
| Total cost | ||
| Tests passed | ||
| Unsupported claims | ||
| Unnecessary changes | ||
| Would I ship it? |
Repeat important tasks more than once. Agent runs have variance, and one heroic result can hide an unreliable average.
My recommendation is simple: choose models per workflow.
Use K3 where its control, context, vision, or capability changes the outcome. Use a faster model for low-stakes work. Route tasks through an evaluation-backed model policy instead of forcing one expensive model to do everything.
The catches
K3 gives us frontier open weights. It also arrives with several practical constraints.
It is enormous
The native checkpoint occupies about 1.56 TB. Efficient serving needs a cluster with huge memory capacity and fast links between accelerators.
Most developers will access K3 through somebody else’s hardware. The ownership benefit still exists because several companies can operate the same model and organizations with enough resources can bring it in-house.
This is the opposite end of the open-model spectrum from compact LLMs that run on personal devices. Both give users more control. K3 trades local convenience for frontier capability.
It is slow
Artificial Analysis measured K3 at roughly 33 output tokens per second through Moonshot’s API, with high time to first token during its evaluation. Other providers report better throughput, and Vercel now lists a faster endpoint.
Always-on reasoning also makes simple interactions feel heavy.
Latency belongs in your workload test. A model that saves one human correction can justify an extra minute on a complex task. The same delay becomes painful inside an interactive product.
It is expensive for an open model
Moonshot charges $3 per million uncached input tokens and $15 per million output tokens. Cached input costs $0.30 per million tokens.
The cache discount helps long agent sessions because each turn resends much of the same history. K3 also produces a lot of reasoning tokens and may use many tool turns.
Price per token tells only part of the story. Artificial Analysis found that K3 cost $10.57 on average for each AA-Briefcase task, driven by token use and an average of 83 turns.
Measure cost per completed task.
The license deserves a read
K3’s custom license allows broad use and modification, with additional terms for very large commercial deployments.
This is more flexible than a closed API and less permissive than Apache 2.0. Companies near the revenue or user thresholds should obtain legal advice before building a commercial service around the weights.
Public weights cannot receive a global safety patch
Moonshot can improve future releases and hosting providers can add safeguards. Existing downloaded copies remain in the wild.
This permanence enables continuity, research, and independent control. It also enables people to remove protections and preserve dangerous capabilities.
Open-weight policy needs to deal with that risk without handing permanent control of advanced intelligence to a few companies.
Where I land
Kimi K3 matters because frontier intelligence is no longer available only as a service rented from a handful of American companies.
Developers can download the weights. Infrastructure companies can compete to host them. Businesses can preserve a model version, adapt it, move it between providers, and run it inside infrastructure they control.
K3 will not become my default for every prompt. It is too large, slow, and expensive for that. I want it available for the work where capability and control justify the cost.
That is how I expect the model market to develop. We will use fast models for routine work, specialist models for narrow tasks, closed frontier APIs where they earn their price, and open frontier models where control matters.
Try K3 through the browser or Kimi Code. Then run the evaluation above against work you already understand.
Clone it, run it, test it, and decide where it belongs in your stack.
Related Posts
How I Write With AI (Without Creating Slop)
Generate high-performing content in hours instead of days by combining your unique perspective with AI's research, structure, and editing power.
The Claude Cookbook, Part 1: Welcome to the Kitchen
Claude isn't just another AI—it's a collaborator that talks back, challenges your thinking, and delivers better results for content, code, and complex situations.
The Ultimate Guide to Claude Cowork: Create Your Personal AI Assistant
Learn how to turn Claude Cowork into a personal AI assistant that organizes your files, drafts documents, schedules recurring tasks, and connects to your tools. The complete guide, no coding required.