whatmodel.sh / Nova Pro
Nova Pro
↗ share
+ contribute
Nova Pro is a closed-weights language model from Amazon, released December 2024.
Catalogue identity notes
Arena entry 'amazon-nova-pro-v1.0' (text, vision). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'amazon-nova-pro-v1.0' as 'Amazon Nova Pro 1.0' (Amazon, Proprietary), linking https://docs.aws.amazon.com/nova/latest/userguide/what-is-nova.html. Released 2024-12: Bedrock model card: 'Model launch date: Dec 05, 2024'. Bedrock model id amazon.nova-pro-v1:0, 'Model lifecycle: Active' (Bedrock model card). First-generation Nova Pro; distinct from nova-2-pro.
$ how it compares
The LLMs ranked either side of Nova Pro, out of 828 with a score, then more from Amazon.
| # | model | score | where | ||
|---|---|---|---|---|---|
| 421 | 50±0 | local | |||
| 422 | 50±1 | local | |||
| 423 | 50±1 | api $1.40/M | |||
| 424 | 50±1 | local | |||
| 425 | 49±2 | local | |||
| more from Amazon | |||||
| 184 | 64±2 | api $3.78/M | |||
| 269 | 58±2 | api $0.94/M | |||
| 339 | 54±2 | api $5.00/M | |||
$ what it's good at
agent tasks▁▁▃▆█▆▅▅▅▄▃▁ #212 of 300 · 14% of its score · 4 tests
Beats o1 (2024-12-17), o3-mini, DeepSeek R1 (Jan '25) here, though they rank higher overall. Trails SmolLM3 3B, Jamba 1.5 Mini, Granite 4.1 3B here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| BFCL V4 (December 2025 archive) | 25.0% ✎ | ▁▁▁▂██▅▅▆▂▂▂ beats 14/77 | 5.3% |
| BFCL v3 +1 | 60.8% ✎ | ▁▁▁▁▁▃▅█▅▄▁▁ beats 83/114 | 4.3% |
| Galileo Agent Leaderboard v1 (tool selection quality) | 86.8% ✎ | ▃▃▃▃▆▅▆▅█▂▅▂ beats 17/31 | 2.4% |
| Galileo Agent Leaderboard v2 (action completion) | 29.0% ✎ | ▅▃·▃▃▅▅█▃█▅▅ beats 4/19 | 2.0% |
coding▁▁▁▃▆██▇▆▄▃▁ #263 of 458 * · 27% of its score · 2 tests
Beats Qwen3-VL 32B Instruct, Solar Open 100B (102B-A12B), GLM-4.7-Flash here, though they rank higher overall. Trails DeepSeek LLM 67B Chat, QwQ-32B-Preview, Phi-3 Medium 128K Instruct here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Aider code editing (133 Exercism Python exercises, two attempts) | 54.1% ✎ | ▁·▁▂▄▁▆▄█▆▂▂ beats 19/62 | 24% |
| BigCodeBench lab | 22.3% ✎ | ▅····▃·█▃▅█▃ beats 2/12 | 3.2% |
chat & writing▁▁▁▃▅▄▅█▆▆▇▃ #232 of 393 * · 12% of its score · 1 test
Beats Mistral Small 4 (119B-A6.5B), Ministral 3 14B Reasoning 2512, Qwen2.5 Coder 32B Instruct here, though they rank higher overall. Trails Flan-T5 XXL, LFM2.5 1.2B Instruct, Gemma 3 4B here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| LMArena (text) | 1290.1 ✎ | ▁▁▁▂▃▃▃▆▆▇█▃ beats 124/379 | 12% |
math█··········█ #2 of 2 * · 13% of its score · 2 tests
vision & documents▁▁▃▃▁▃▄▂▆▇█▄ #127 of 147 · 17% of its score · 3 tests
Trails InternVL2-26B, Qwen3.5 2B, Pixtral 12B (2409) here, though they rank lower overall.
| test | result | vs the others in its run | counts |
|---|---|---|---|
| Arena vision (style controlled) | 1018.7 ✎ | ▁▁▂▃▂▂▄▅▅▆██ beats 14/145 | 8.4% |
| CharXiv descriptive questions lab | 70.5% ✎ | ▂▄▄▅▇▄█▇▇▂▁▂ beats 13/58 | 4.4% |
| CharXiv (reasoning questions) lab | 40.6% ✎ | ▂▅▃▅▅▆▆▅▆█▆▂ beats 19/100 | 4.3% |
other tests4 not in a task · 16% of its score
| test | result | vs the others in its run | counts |
|---|---|---|---|
| GPQA Diamond lab | 50.0% ✎ | ▁▁▁▁▂▄▅▅███▄ beats 86/310 | 9.5% |
| MMLU lab | 85.9% ✎ | ▁▁▁▁▁▂▃▅█▃▆▃ beats 161/183 | 6.0% |
| Vectara hallucination leaderboard, 2025 dataset (HHEM-2.3, factual consistency rate) | 98.2% ✎ | ▁▁▂▃▄▄█▆▃▃▂▁ beats 124/140 | 0.8% |
| Vectara hallucination leaderboard (HHEM-2.3, factual consistency rate) | 94.9% ✎ | ▁▂▁▂▅█▂▃▄▃▁▁ beats 91/98 | 0.0% |
$ where to run it
Through an API
api · Amazon Bedrock · $1.40/M · $0.8 in / $3.2 out per 1M tokens · 300k context · docs.aws.amazon.com ↗ · price sourceUSD per 1M tokens, Standard tier, geo cross-Region inference and in-Region, US East (N. Virginia). Amazon Nova Pro (amazon.nova-pro-v1:0). Observed 2026-09-28 (page price data $0.0008/$0.0032 per 1K tokens).
$ how the score was worked out · Amazon vendor-reported benchm… 42%, Aider code editing benchmark… 24%, LMArena leaderboard dataset 21% and 3 more
Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works
| source | results | share of the score |
|---|---|---|
| 8 | 42% | |
| 1 | 24% | |
| 2 | 21% | |
| 2 | 8% | |
| 2 | 4% | |
| 2 | 1% | |
| prior · pull toward the middle | 1% | |
| weighted average | = 49.5 |
$ improve this page
Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.
data updated · sources and licences · json