MODEL HISTORY
Devstral 2 指标历史
Devstral 2 的公开评测事实历史，共 90 条观测、66 项指标；只记录来源变化，不插值、不合成本站总分。
怎样理解这份历史
每条记录对应来源快照中的一个原始指标。同一口径下相同值重复抓取不会制造新记录；数值、临时状态或来源状态变化时追加，核实后的方法版本另立指标身份。首个快照是本站的可追溯起点，不代表该指标第一次对外发布。当前模型来源为 Artificial Analysis。
Index、Elo、百分比等单位不能互相相减，也不会在这里合成为“综合总分”。
本页含 AA Intelligence Index v4.3.2 的完整方法观测。该版本对 GDPval-AA v2.1 与 AA-Briefcase v1.1 的 Elo 拟合使用 Crowd-BT；旧 v4.3 与 v4.3.1 点位仍保留各自版本、值与日期，不能将跨版本差额解释成模型能力变化。查看当前方法边界 →
本页还含来源记录为裁判协议 v4.3.1 的独立实时 Elo 历史。它是当时的单项榜单协议，不被当前完整 Index v4.3.2 重标；未区分裁判协议的更早 Elo 仅作历史参考。Intelligence Index 中的 Elo 贡献在模型加入时固定，不能用独立实时 Elo 重算指数。核对 AA 方法说明 ↗
APPEND-ONLY FACTS
观测记录
按观测时间倒序；同日多项指标分别保留。
| 观测日期 | 基准 / 版本 | 指标 | 原始值 | 来源 | 状态 |
|---|---|---|---|---|---|
| Artificial Analysis intelligence component evaluationsv4.3.2 | AutomationBench-AA partial scorefraction | 3.1% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2当前完整方法 v4.3.2 · Crowd-BT Elo；不由实时 Elo 重算 Intelligence Index | AA-Briefcase overall Eloelo | 472 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | CritPtfraction | 0.0% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | GDP.pdf all-passfraction | 2.4% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2当前完整方法 v4.3.2 · Crowd-BT Elo；不由实时 Elo 重算 Intelligence Index | GDPval-AA v2elo | 531 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | Humanity's Last Examfraction | 3.6% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis capability indicesv4.3.2 | Intelligence Indexindex | 8.6 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | AA-LCR v1.1fraction | 32.3% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | AA-Omniscienceindex | -46.7 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | AA-Omniscience accuracyfraction | 20.8% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | AA-Omniscience hallucination ratefraction | 85.3% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | SciCodefraction | 32.8% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.2 | Terminal-Bench v4.0fraction | 0.0% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis GDPval-AA任务 v2 · 裁判 v4.3.1历史参考 · 裁判协议 v4.3.1；不与当前完整方法 v4.3.2 跨协议比较 | Eloelo | 689 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis AA-Briefcase来源未标任务版本 · 裁判 v4.3.1历史参考 · 裁判协议 v4.3.1；不与当前完整方法 v4.3.2 跨协议比较 | Eloelo | 483 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.1历史参考 · 裁判协议 v4.3.1；不与当前完整方法 v4.3.2 跨协议比较 | AA-Briefcase overall Eloelo | 483 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3.1历史参考 · 裁判协议 v4.3.1；不与当前完整方法 v4.3.2 跨协议比较 | GDPval-AA v2elo | 689 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Model availabilitypoints | 5.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Model transparencypoints | 0.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Openness Indexindex | 27.8 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Posttraining data accesspoints | 0.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Posttraining data licensepoints | 0.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Pretraining data accesspoints | 0.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis Openness Indexvsource-unversioned | Pretraining data licensepoints | 0.0 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis GDPval-AAv2历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | Eloelo | 689 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis AA-Briefcasevsource-unversioned历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | Eloelo | 483 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | AutomationBench-AA partial scorefraction | 3.1% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | AA-Briefcase overall Eloelo | 483 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | CritPtfraction | 0.0% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | GDP.pdf all-passfraction | 2.4% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | GDPval-AA v2elo | 689 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | Humanity's Last Examfraction | 3.6% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis capability indicesv4.3 | Intelligence Indexindex | 9.4 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | AA-LCR v1.1fraction | 32.3% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | AA-Omniscienceindex | -46.7 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | AA-Omniscience accuracyfraction | 20.8% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | AA-Omniscience hallucination ratefraction | 85.3% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | SciCodefraction | 32.8% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.3 | Terminal-Bench v4.0fraction | 0.0% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 11.6 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 52.0 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 2.0 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis capability indicesvpublic-model-v1 | Agentic Indexindex | 10.6 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 11.4 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | GDPval-AAelo | 744 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | GDPval-AA normalizedfraction | 12.2% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis capability indicesvpublic-model-v1 | Intelligence Indexindex | 19.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | AA-LCRfraction | 31.3% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | AA-Omniscienceindex | -46.7 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 51.4 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | Tau Bankingfraction | 10.5% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 1.6 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 15.3 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 35.6 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 1.3 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 26.5 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | GDPval-AAelo | 745 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | GDPval-AA normalizedfraction | 12.3% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 19.9 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 1.3 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 8.9 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 65.9 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 1.3 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis capability indicesvpublic-model-v1 | Agentic Indexindex | 10.6 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis agentic capability indexvunversioned | agentic capability indexindex | 10.6 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis coding capability indexvunversioned | coding capability indexindex | 31.3 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis finance capability indexvunversioned | finance capability indexindex | 13.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis strategy capability indexvunversioned | strategy capability indexindex | 15.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis legal capability indexvunversioned | legal capability indexindex | 13.9 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis healthcare capability indexvunversioned | healthcare capability indexindex | 13.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis engineering capability indexvunversioned | engineering capability indexindex | 22.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis economics capability indexvunversioned | economics capability indexindex | 17.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis capability indicesvpublic-model-v1 | Coding Indexindex | 31.3 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 上下文窗口tokens | 256,000 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | CritPtfraction | 0.0% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 端到端响应时间seconds | 8.5 秒 | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1历史参考 · 原记录未区分当前裁判协议，不作跨协议能力变化比较 | GDPval-AAelo | 739 | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | GDPval-AA normalizedfraction | 12.0% | Artificial Analysis ↗第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | GPQA Diamondfraction | 59.4% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | Humanity's Last Examfraction | 3.6% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 输入价格 / 1M Tokenusd_per_1m_tokens | US$0 | Model Coordinate repository snapshots第三方评测 | 来源报告 0 / 未验证 | |
| Artificial Analysis capability indicesvpublic-model-v1 | Intelligence Indexindex | 19.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | AA-LCRfraction | 30.0% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | AA-Omniscienceindex | -46.2 | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 输出价格 / 1M Tokenusd_per_1m_tokens | US$0 | Model Coordinate repository snapshots第三方评测 | 来源报告 0 / 未验证 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 生成速度tokens_per_second | 70.1 Token/s | Model Coordinate repository snapshots第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | SciCodefraction | 33.1% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | Tau Bankingfraction | 10.3% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis intelligence component evaluationsv4.1 | Terminal-Bench v2.1fraction | 30.3% | Artificial Analysis第三方评测 | 有效 | |
| Artificial Analysis model aggregatevpublic-model-v1 | 首个回答 Token 等待seconds | 1.4 秒 | Model Coordinate repository snapshots第三方评测 | 有效 |