🔍 Read the full analysis: What Kimi K3.1 Pro’s Three-Point Gap To The Frontier Means on ThorstenMeyerAI.com
Get hardware and tech essentials delivered free with Prime
- Fast, free delivery on millions of items
- Prime Video, Amazon Music and more included
- Member-only deals all year
TL;DR
Kimi K3.1 Pro scored 55.1 on Artificial Analysis’ Intelligence Index, placing fourth and 2.5 points behind the highest-scoring model listed. Its price per index task was about $2.11, compared with $5.98 for Claude Opus 5.5, but the model’s weights are promised for November 4 and its licence has not been published.
Kimi K3.1 Pro, launched by Moonshot AI on October 23, scored 55.1 on Artificial Analysis’ Intelligence Index, ranking fourth among the models listed and 2.5 points below the leader, Claude Opus 5.5. The result puts it close to leading proprietary systems on that benchmark, but its weights are only promised for November 4, and Moonshot has not published a licence for them.
Artificial Analysis’ figures, reported on October 24, rank Claude Opus 5.5 at 57.6, Claude Sonnet 5.5 at 56.0, and Muse Wonder Full at 55.8, ahead of Kimi K3.1 Pro. The result is a notable narrowing of the gap on this particular index: the previous leading open-weights model in the source’s comparison, Xiaomi’s MiMo-V2.6-Pro, scored 46.3. Kimi K3.1 Pro is not yet an available open-weights alternative, however; Artificial Analysis describes its prospective lead in that category as conditional on publication of its weights.
Artificial Analysis lists K3.1 Pro as a mixture-of-experts model with 2.8 trillion total parameters and 104 billion active parameters, a one-million-token context window, and text and image input. It was made available through the Kimi apps, Kimi Work, Kimi Code and the Kimi API. The evaluator estimates its cost at $2.11 per Intelligence Index task, compared with $5.98 for Opus 5.5 at its highest reasoning setting. The listed API prices are $2 per million input tokens and $10 per million output tokens for both models.
The strongest relative result in the figures supplied is on Terminal-Bench 4.0, a test of agentic tasks: K3.1 Pro scored 67%, compared with 13% for Kimi K3. On GDPval-AA, a simulated knowledge-work evaluation, it scored 1,846 Elo, below Opus 5.5 at 1,866 and Muse Wonder Full at 1,857. Its score on Humanity’s Last Exam was 52%, against 47% for K3 and 61% for Opus 5.5. These results describe specific tests, not a general guarantee of performance in everyday use.
Infographic 01 · Claimed vs. measured
Moonshot says “matches the strongest.” Independent tests say: close.
The KPIs at the top are independent measurements. Vendor numbers and independent numbers come from different harnesses, so they are shown side by side, never mixed.
Moonshot reports
vendor claims own harness, partly internal tests
| Benchmark | K3.1 Pro | Comparison |
|---|---|---|
| Terminal-Bench 4.0 | 65.7% | vs. Claude Opus 5.5: 66.4% |
| BenchCAD with tools | 92.7% | vs. Claude Opus 5.5: 96.2% |
| OfficeQA Pro v2 | 64.4 | vs. Claude Opus 5.5: 62.2 |
| Kimi Hallu Bench Hard internal | 8.3% | vs. Kimi K3: 23.4% (about −65%) |
Artificial Analysis measured
independent highest reasoning setting per model
| Measurement | K3.1 Pro | Comparison |
|---|---|---|
| Terminal-Bench 4.0 | 67% | vs. Claude Opus 5.5 (max): 60% |
| GDPval-AA | 1,846 Elo | vs. Claude Opus 5.5: 1,866 |
| Humanity’s Last Exam | 52% | vs. Claude Opus 5.5: 61% |
| AA-Omniscience hallucination rate | 44% | vs. Kimi K3: 53% · Gemini 4 Argon: 15% |
The 65% hallucination drop holds on Moonshot’s own stress test. On an independent knowledge test, the rate fell from 53% to 44%.Moonshot: the stress test rates “do not represent overall error rates in daily use.”
Sources: Moonshot AI, Kimi K3.1 Pro tech blog (23 Oct 2026) (left card, vendor charts); Artificial Analysis launch article (23 Oct 2026) and Artificial Analysis model page (data as of 24 Oct 2026) (KPIs and right card).
Powered by Thorsten Meyer AI
A Narrower Gap, With Conditions
The score matters because it suggests a model from a company planning to publish its weights can compete closely with leading closed models on one broad evaluation. If Moonshot releases usable weights under a licence that permits the intended deployment, organisations could have more control over where a model runs and how it is integrated. That may matter for teams with data-governance, customization or infrastructure requirements, though the benchmark alone does not establish those operational benefits.
The cost comparison also gives buyers a reason to examine the model: Artificial Analysis estimates about $2.11 per index task for K3.1 Pro versus $5.98 for Opus 5.5. Those estimates are specific to the evaluator’s test setup and do not establish that Kimi will be cheaper for every workload. Actual costs can depend on usage, task complexity, reasoning settings, hosting and any additional tools required.
For now, the difference between a high-scoring hosted service and a practical open-weights option remains material. The model is accessible through Moonshot’s products and API, but organizations cannot yet independently run the weights. The unpublished licence also leaves unresolved what use, modification and redistribution terms will apply.
AI model inference GPU workstation
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
From Kimi K3 to K3.1 Pro
Moonshot describes K3.1 Pro as a more heavily post-trained version of Kimi K3. On the Artificial Analysis figures supplied, Kimi K3 scored 43.6 on the Intelligence Index, while K3.1 Pro scored 55.1. The same comparison shows a sharp rise on Terminal-Bench 4.0, from 13% to 67%, while the increase on Humanity’s Last Exam was smaller, from 47% to 52%. Those changes point to different levels of improvement across different evaluation types; they do not mean the model improved by the same amount on all tasks.
Moonshot’s launch material also highlights coding, game development, parametric 3D work and finance tasks. The company says it produced full projects in Unity, Unreal Engine and Godot, and reports a 92.7% result on BenchCAD with tools. Those are vendor-reported results and demonstrations, not independent confirmation of general capability. Moonshot’s stated internal test showing 65% fewer hallucinations than K3 also differs from Artificial Analysis’ AA-Omniscience evaluation, where the rate fell from 53% to 44%. The test methods and their limits matter when comparing those numbers.
“deliberately crafted”
— Moonshot AI
high VRAM graphics card for local large language models
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Weights, Licence and Real-World Results
The weights have not yet been published in the information available as of October 24, and the licence for K3.1 Pro is also unpublished. Until both are available, it is not possible to confirm whether users will be able to download, modify or deploy the model under terms that fit their needs. The model’s size may also put self-hosting beyond the reach of many users: running a model with 2.8 trillion total parameters could require substantial infrastructure, although the exact hardware and operating costs are not specified here.
Benchmark results do not settle how reliably the model will perform on a company’s own tasks. Artificial Analysis reports its own evaluations, while several of Moonshot’s most striking claims come from internal tests and demonstrations. The supplied source also ends partway through its discussion of the AA-Omniscience result, so further comparisons or qualifications are not available here. No independent assessment of Moonshot’s game-development demonstrations or its internal finance results is provided in the source material.
AI development workstation with 128GB RAM
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
The November 4 Release Test
The next concrete milestone is Moonshot’s stated target to publish K3.1 Pro’s weights by November 4, 2026. Their arrival, along with the licence terms, will determine whether outside developers can evaluate and run the model independently. If the release happens, useful follow-up questions will include what hardware is needed, whether the weights match the version tested by Artificial Analysis, and whether other evaluators reproduce the reported results.
Until then, readers can distinguish between what is already available and what remains promised: K3.1 Pro is live in Moonshot’s apps and API, and Artificial Analysis has published benchmark and cost figures; the open-weights release and its terms are still pending. The reported scores show proximity on selected tests, not parity across every use case or a guarantee of lower total costs. Model performance can vary by task, and AI systems can produce errors; organisations should test outputs against their own requirements before relying on them.
As an affiliate, we earn on qualifying purchases.
Key Questions
How close did Kimi K3.1 Pro score to the top model?
It scored 55.1 on Artificial Analysis’ Intelligence Index. The listed leader, Claude Opus 5.5, scored 57.6, a gap of 2.5 points, or about three when rounded.
Can users download Kimi K3.1 Pro now?
Not according to the information available as of October 24, 2026. Moonshot said the weights were due by November 4, and had not published a K3.1 Pro licence.
Is Kimi K3.1 Pro cheaper than Claude Opus 5.5?
Artificial Analysis estimated a cost of $2.11 per Intelligence Index task for Kimi K3.1 Pro and $5.98 for Opus 5.5 in its evaluation. That comparison is specific to the benchmark setup; costs can differ across real workloads and deployment methods.
What result stood out most in the benchmark figures?
On Terminal-Bench 4.0, K3.1 Pro scored 67%, compared with 13% for Kimi K3. The figures suggest a marked gain on that agentic-task benchmark, but do not establish performance across all coding or agent workflows.
Does the 65% hallucination reduction apply to everyday use?
No such conclusion is supported by the source. The 65% figure comes from Moonshot’s internal stress test; the company says the test was deliberately crafted and does not represent overall error rates in daily use. Artificial Analysis measured a decrease from 53% to 44% on its separate AA-Omniscience evaluation.
Source: ThorstenMeyerAI.com
Halloween Picks
halloween
As an affiliate, we earn on qualifying purchases.
