whatmodel.sh / Reka Core (2024-09-04)

Reka Core (2024-09-04) is a closed-weights language model from Reka AI, released September 2024.

Catalogue identity notes

Comparison-only. Arena entry 'reka-core-20240904' (text). LMArena's leaderboard table (arena-leaderboard space @6f2eeeb) labels 'reka-core-20240904' as 'Reka-Core-20240904' (Reka AI, Proprietary), linking https://docs.reka.ai/available-models. Released 2024-09: date in Reka's API snapshot id. Dated Reka API snapshot (FastChat registry lists reka-core-20240904 under 'Reka Core'). Reka's current docs list only reka-flash and reka-edge as public models, so no API is asserted.

52.3±3.3comparison only: no current run option verifiedfrom 1 benchmark result across 1 source* thinly tested, treat the rank as provisional

$ how it compares

The LLMs ranked either side of Reka Core (2024-09-04), out of 1132 with a score, then more from Reka AI.

#modelscorewhereRAMreleased
505Reka Flash 3 (21B) Reka AI52±6local~14GB2025-03
506Yi-Large Preview 01.AI52±1comparison only2024-05
507Reka Core (2024-09-04) Reka AI52±3comparison only2024-09
508Qwen2.5-Math 7B Instruct Alibaba52±2local~6GB2024-09
509LFM2.5 8B-A1B Liquid AI52±1local~6.5GB2026-05
more from Reka AI
523Reka Flash 3.1 (21B) Reka AI52±6local~14GB2025-05
554Reka Flash (2024-09-04) Reka AI51±3comparison only2024-09
632Reka Core (2024-05-01) Reka AI48±1comparison only2024-05

see all LLMs · find the ones that fit your machine

$ what it's good at

chat & writing▁▁▁▃▅▅▆█▆▆▆▂ #331 of 579 * · 95% of its score · 1 test

Beats Mistral Small 4 (119B-A6.5B), Ministral 3 14B Reasoning 2512, Qwen2.5 Coder 32B Instruct here, though they rank higher overall. Trails Flan-T5 XXL, LFM2.5 1.2B Instruct, Gemma 3 4B here, though they rank lower overall.

testresultvs the others in its rundifficultycountswhy
LMArena (text)1288.0 ✎▁▁▁▂▃▃▃▆▆▇█▃ beats 119/379avg 1268▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 95%blunt

$ where to run it

No verified API or download recorded yet · add one

$ how the score was worked out · LMArena leaderboard dataset 95%

Each result implies a score on its own, after adjusting for how hard its test is and who ran it. The score is their weighted average, with a small pull toward the middle for thinly tested models. Each test's weight is its counts column above; here it's added up by who ran the tests. How it works

sourceresultsshare of the scorelicence
LMArena leaderboard dataset1▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 95%CC BY 4.0
prior · pull toward the middle▇ 5%
weighted average= 52.3

$ improve this page

Use a short GitHub form or edit the data through a pull request. Every number needs a source; here's which ones we can use.

data updated · sources and licences · json