ScoreIA — leaderboards by domain

preview 0.1 · unmeasured stays blank

Competition is per domain, not a single number.

These boards are a methodological preview 0.1, not a France ranking or an established scientific protocol. French instruction-following 0.1 still checks format. Honesty v1 and code v1 are real trials. Maze and chamber too. One row = one recorded context. Legacy 0.1 cards without a model digest remain labelled as such. No run = not measured. Every card in a cell is linked. Local, API and product-plan stay apart.

Logic

Snapshot	Measure	Evidence level	Details
mistral:latest · Ollama · local · mutable tag, digest absent	17/20	Exploratory1 seed	View 20 cards sia-060c2e393b20e3f2 sia-09d856e7866a7710 sia-1a6d26985665ec10 sia-4b4ecd8d2a3d1a71 sia-4bf3167e5e2acdf7 sia-54659470f088b900 sia-87b190966d3ae4a1 sia-9d2465ae61db15f9 sia-9e78f77a32ef2ec9 sia-a4a08f5ba2164871 sia-ac70f8c2f618551b sia-b8ef11bb735f29de sia-be21e00844640686 sia-cb9346149959efd3 sia-d67161785256ca26 sia-d8de47607f0b61e8 sia-de334f9b3b5a82d8 sia-f030f6887a107e2c sia-f7c9186d6bf75419 sia-ffe5457b12d4bfa5
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	19/20	Exploratory1 seed	View 20 cards sia-0bb17490b6ff49bb sia-0f880f9cd2ef32cc sia-1257ee5d682aee4c sia-20f4514e32a862d1 sia-26bff9c821818d61 sia-3bd07611dcf8b7c8 sia-43f79f89e488a502 sia-48b954b9a03cc222 sia-4c9b9432e23248ab sia-599bd0f48b813438 sia-5f6a7612197c744f sia-72dfdacc4169606b sia-773b0cf9a6848583 sia-79544807ed0c298f sia-c08ef32e0a39269d sia-d652eb3d45c852c5 sia-dcc3ab3d4da9aaa2 sia-e02bfd644c794e83 sia-f10da0caead8cbed sia-f3aa8235a3ecd438
qwen2.5:latest · Ollama · local · mutable tag, digest absent	19/20	Exploratory1 seed	View 20 cards sia-1a136b12f40c4428 sia-22cf508f7747a268 sia-23b9321f0de81af6 sia-40668cb4380137b7 sia-504975d830b0546a sia-5a2da34996f68645 sia-6609bc11c52cc552 sia-78ed5aa97fcdba4a sia-8983d87c44625d75 sia-8f07c7f7012781ff sia-93c25d03d5344bf7 sia-950d282624ac0663 sia-a9071c474c77fc44 sia-af6deff195aa8a45 sia-c3d66f589d5646c0 sia-cb7333d700ab2154 sia-cb8ececa56250e20 sia-d647a7f716ecb384 sia-ed22784974d09096 sia-f028b906a8b261d8
hermes3:8b · Ollama · local · digest absent (card 0.1)	19/20	Exploratory1 seed	View 20 cards sia-24f6c6cf068d4a33 sia-2767193609ec7383 sia-2a4e42196eb3cea2 sia-3c4974e461f8eece sia-7d8851e7ed3b9dcf sia-7f4b58a498e0db02 sia-8991cbaae034b2bd sia-9768ac697b91b51e sia-a88c098caac87e07 sia-b4ab0a20b0dfae09 sia-b762c2f9e493e2a7 sia-c71e593787c93dcd sia-cba3dd0aee1eaa4b sia-cd1cc3000a58ebc7 sia-d1a3ffe54a201fb5 sia-d987d74e4d11cf68 sia-e07e839a9d2a2e14 sia-eb0fb4be3f8c82fc sia-fb027eca6853dfa8 sia-fcee7c7ed40df545
llama3.1:latest · Ollama · local · mutable tag, digest absent	20/20	Exploratory1 seed	View 20 cards sia-01ea1aefecd1e85a sia-1dc534d3cd7d25fe sia-22b205ac394e6b99 sia-2f7b53caa48c5f11 sia-3125a881a7c531ff sia-33f3ddb6d81337ce sia-3e9598aee4ee19e7 sia-42b7aa4d37834b7b sia-4b6d1689b0e0e26b sia-4bfffb3642fde95c sia-56bf78e1396ca5a6 sia-60c392589e51e193 sia-7c357355276c48fd sia-983e58a52f20919e sia-9b225e5e8ea19691 sia-9ec5324740be42e9 sia-a254e57b23618c65 sia-d6f437c6868126ec sia-ec918a55cd8f118d sia-f241f017f69d8032
grok-4.3 · API xAI	20/20	Exploratory1 seed	View 20 cards sia-02c6d235e2c59ab8 sia-0dbb83fb4aa4e13a sia-1424257ec4dde551 sia-1800703406a337e2 sia-213da780dcda8656 sia-22fbc806708cc931 sia-2a2baedc525e5027 sia-2c26efbbbcc37687 sia-3bad7b6fbe05277f sia-456c2dda10f4fde1 sia-510c4df9b5be5063 sia-6730899af355bc49 sia-6b2a23e22ad9010b sia-79f27527b0b40913 sia-c27696967bea3fc6 sia-cebc326eea7cfc96 sia-d09db1637d1924d2 sia-d67d0892d653b7b9 sia-d836c61ec420195d sia-e51b808e704ea3ae
gemini-2.5-flash · API Google	20/20	Exploratory1 seed	View 20 cards sia-3d3b434503133e1e sia-44cba5012fb5a4fc sia-48d8a2f10f2e26a3 sia-535f770f8e479c35 sia-5d44966c992fb04c sia-73b4fb919833e490 sia-847b60b4699f0f03 sia-8c9eacfa93df07c7 sia-92930f8d42faa5fc sia-97a09c7f15d12e21 sia-a439a3bc8d618111 sia-ab7dacec90ccffe5 sia-b878e4cfe89bb916 sia-bb053075cd873c9d sia-c11027adf26e13c1 sia-d37c35f5370cd45b sia-dce19be6c21de8b7 sia-e9f7fda3607d26c5 sia-ed7419a972db2190 sia-f70d78fcc48189cc

Honesty

Snapshot	Measure	Evidence level	Details
qwen2.5:latest · Ollama · local · mutable tag, digest absent	1/3	Exploratory1 seed	View 3 cards sia-41619e18c60a1c60 sia-41b2d2add5f67383 sia-cd271dc73e2640a6
hermes3:8b · Ollama · local · digest absent (card 0.1)	2/3	Exploratory1 seed	View 3 cards sia-10476ccf439e5c20 sia-ed8ce49c5b293bac sia-e316459324cec89e
mistral:latest · Ollama · local · mutable tag, digest absent	2/3	Exploratory1 seed	View 3 cards sia-1e343e5b37ad5339 sia-282498bb35b288a8 sia-c5c3a66e08da416f
llama3.1:latest · Ollama · local · mutable tag, digest absent	2/3	Exploratory1 seed	View 3 cards sia-8fa186d6a1cee684 sia-9e46535f22121279 sia-e6f3c453131c33de
grok-4.3 · API xAI	3/3	Exploratory1 seed	View 3 cards sia-08f1f373713e41dd sia-3e834c7c8057fb60 sia-e528cb7d3ce0e2d4
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	3/3	Exploratory1 seed	View 3 cards sia-62aedc55a5d13a1f sia-85a3bb9149541ead sia-8d9e8f2835de1a63
gemini-2.5-flash · API Google	3/3	Exploratory1 seed	View 3 cards sia-f2228a4ecf3c6545 sia-a6d2090bc703f86a sia-e2d15c7c108be03d

Code

Snapshot	Measure	Evidence level	Details
qwen2.5:latest · Ollama · local · mutable tag, digest absent	2/2	Exploratory1 seed	View 2 cards sia-041b60dc0d906a45 sia-74b41a106cb7d268
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	2/2	Exploratory1 seed	View 2 cards sia-5b16946af346e178 sia-ce855a3c236c8f09
gemini-2.5-flash · API Google	2/2	Exploratory1 seed	View 2 cards sia-7ba79eb57a6f0fba sia-d7755fa74c5d2764
hermes3:8b · Ollama · local · digest absent (card 0.1)	2/2	Exploratory1 seed	View 2 cards sia-b7ac190f769c9fb8 sia-c271335d18659688
llama3.1:latest · Ollama · local · mutable tag, digest absent	2/2	Exploratory1 seed	View 2 cards sia-bbf8da236b70ded6 sia-cbe10a79f83cb35b
grok-4.3 · API xAI	2/2	Exploratory1 seed	View 2 cards sia-dae1afed3310e30b sia-dafd739e28e8245c
mistral:latest · Ollama · local · mutable tag, digest absent	2/2	Exploratory1 seed	View 2 cards sia-dd3795eee922156b sia-f88d4470ae71fe64

Maze

Snapshot	Measure	Evidence level	Details
llama3.1:latest · Ollama · local · mutable tag, digest absent	0/8	Exploratory1 seed	View 8 cards sia-116c45b2bf55f8dd sia-223395c74d24ac12 sia-513884d9aed0ea34 sia-7608f38038997ed7 sia-973dbda01a2f2dab sia-bed98eba18cb6d24 sia-c05794e56ce64a95 sia-c34e7eccfca2e39a
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	0/8	Exploratory1 seed	View 8 cards sia-153b8afeccb144e6 sia-32c7bcdb1bda0f0c sia-4ababc41dd9801d3 sia-50e9f485932cf7dd sia-7959ca232a332580 sia-9605d0cfacc10fc6 sia-c238f7291eb9e772 sia-ebba420796ed06cc
mistral:latest · Ollama · local · mutable tag, digest absent	0/8	Exploratory1 seed	View 8 cards sia-2c2e808cb6f6e99b sia-447e73daee476c1a sia-54c6fd92e8675e2e sia-557f2cad73cab723 sia-6eb7bc84bb4e635f sia-9f4737d8971dbfd0 sia-b7ad8e91cd6f44f7 sia-e571620c9a169b46
qwen2.5:latest · Ollama · local · mutable tag, digest absent	0/8	Exploratory1 seed	View 8 cards sia-307ad05ae8334780 sia-3bcaae9c5c32ed03 sia-40da5724f7a4da1f sia-5064d099dbcfb0bc sia-65f2c6a5436dafeb sia-be7199392da1cf4c sia-d9a89b19de125427 sia-e25098bd849a9736
hermes3:8b · Ollama · local · digest absent (card 0.1)	0/8	Exploratory1 seed	View 8 cards sia-4d73c69156a15cca sia-55c2c6ef683c7274 sia-93183e620fcfa8b0 sia-a7baa818a24ca399 sia-c8e1fcbea0d87f02 sia-d67a60c808734ee0 sia-e09da21b9e3a276a sia-f6770732e2455e62
gemini-2.5-flash · API Google	7/8	Exploratory1 seed	View 8 cards sia-2aa3137996933f76 sia-8c127524c848470c sia-8ef5f5a55e3e4cdc sia-9226c9e9f3f94445 sia-93e4e65ceb8d730a sia-9fe055202aa9dc53 sia-b4659b7d6fa11d23 sia-f3dba274064b7b6b
grok-4.3 · API xAI	8/8	Exploratory1 seed	View 8 cards sia-8382cf113f7b3af8 sia-9e7158ceb467caf2 sia-c805fcc08096f199 sia-c97ac31720f3dceb sia-db5af9b004371846 sia-dd940cc48586affe sia-e333b17b9833c884 sia-fe1fa50cfb3d3bca

Instruction

Snapshot	Measure	Evidence level	Details
qwen2.5:latest · Ollama · local · mutable tag, digest absent	FAIL	Exploratory1 seed	View 1 card sia-293d18a01dc3267f
llama3.1:latest · Ollama · local · mutable tag, digest absent	FAIL	Exploratory1 seed	View 1 card sia-aefaf943597ceaeb
hermes3:8b · Ollama · local · digest absent (card 0.1)	PASS	Exploratory1 seed	View 1 card sia-0bc699de72f0b693
gemini-2.5-flash · API Google	PASS	Exploratory1 seed	View 1 card sia-56fc7f8c3a75b241
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	PASS	Exploratory1 seed	View 1 card sia-7d5d85573ef56fe6
grok-4.3 · API xAI	PASS	Exploratory1 seed	View 1 card sia-d26eed81adaba1ca
mistral:latest · Ollama · local · mutable tag, digest absent	PASS	Exploratory1 seed	View 1 card sia-f0123f315443c81b

FR

Snapshot	Measure	Evidence level	Details
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	3/3	Exploratory1 seed	View 3 cards sia-12e4e9abaaf5a88d sia-243d4d4b1eddae58 sia-d0b445844af5319f
mistral:latest · Ollama · local · mutable tag, digest absent	3/3	Exploratory1 seed	View 3 cards sia-138b7b05b608587f sia-1b01788a2a4b8d29 sia-bcc05baa55566e78
hermes3:8b · Ollama · local · digest absent (card 0.1)	3/3	Exploratory1 seed	View 3 cards sia-2086793875367fe8 sia-437aac973ebc97fe sia-ccc243e8392bd3bf
qwen2.5:latest · Ollama · local · mutable tag, digest absent	3/3	Exploratory1 seed	View 3 cards sia-46fe1468c89dac58 sia-7b2e30b76122e65b sia-a51029c2d515da73
grok-4.3 · API xAI	3/3	Exploratory1 seed	View 3 cards sia-545906142c4b8e1d sia-7a99ddd9bebadccc sia-f64a7e4c9efd4ebe
gemini-2.5-flash · API Google	3/3	Exploratory1 seed	View 3 cards sia-76457ca008aabac8 sia-caab445697909bb9 sia-ee816c1cce5333f6
llama3.1:latest · Ollama · local · mutable tag, digest absent	3/3	Exploratory1 seed	View 3 cards sia-77ab8b48c602486b sia-96bdcf8ea0c40097 sia-ad00bd639605382d

Chamber

Snapshot	Measure	Evidence level	Details
llama3.1:latest · Ollama · local · mutable tag, digest absent	FAIL	Exploratory1 seed	View 1 card sia-3eadc0ed32154333
hermes3:8b · Ollama · local · digest absent (card 0.1)	FAIL	Exploratory1 seed	View 1 card sia-60c24593e7d1722d
qwen2.5:latest · Ollama · local · mutable tag, digest absent	FAIL	Exploratory1 seed	View 1 card sia-bf43fd0a844d794f
mistral:latest · Ollama · local · mutable tag, digest absent	FAIL	Exploratory1 seed	View 1 card sia-c1c4891a2df768af
qwen2.5:14b · Ollama · local · digest absent (card 0.1)	FAIL	Exploratory1 seed	View 1 card sia-f7ae4711e72962ad
grok-4.3 · API xAI	PASS	Exploratory1 seed	View 1 card sia-418069eff13ee684
gemini-2.5-flash · API Google	PASS	Exploratory1 seed	View 1 card sia-7df137fddd8d3232

Evidence level = distinct seeds: 1–2 exploratory, 3–4 provisional, 5+ confirmed. Unmeasured stays blank.

Throughput source: OutilsIA evidence OIA-LC-BENCH-20260727-HERMES3-8B-RTX4080S · 118.5 tok/s · RTX 4080 SUPER · 2026-07-27. FR “act or narrate”: 3/3 local and Grok/Gemini API. Maze: Grok API 8/8, Gemini 7/8, local 0/8. Chamber: Grok/Gemini PASS, local FAIL. Qwen 2.5 14B: honesty 3/3, instruction PASS. Open “View cards” to inspect the JSON evidence. The Ring does not write these rows. · Open Chamber · Public attempts · Protocol.