{"protocol":"scoreia","protocol_version":"0.1","status":"legacy","current":"https://scoreia.ai/spec/0.2","observation":"1 trial × 1 model × 1 seed","identity":{"en":"ScoreIA is an open protocol for scoring AI models. A ScoreIA card describes a model, a named context and a versioned suite. It is neither a universal ranking nor a prediction of citations.","fr":"ScoreIA est un protocole ouvert de notation de modèles d’IA. Une carte ScoreIA décrit un modèle, un contexte nommé et une suite versionnée. Ce n’est ni un classement universel ni une prédiction de citations."},"empty_cell":"not measured","schema":"https://scoreia.ai/schema/scoreia-card-0.1.json","cards":"https://scoreia.ai/cards","html":{"en":"https://scoreia.ai/en/protocol/","fr":"https://scoreia.ai/protocole/"},"arenas":{"law":{"en":"Four channels, never merged on one row. Empty cell = not measured. Host Uplift is derived later — not a rank, not who_is_best.","fr":"Quatre canaux, jamais fusionnés sur une même ligne. Cellule vide = non mesuré. Host Uplift est dérivé plus tard — pas un rang, pas who_is_best."},"never_merge_on_one_row":true,"channels":{"provider_api":{"what":"official HTTP API, temperature 0","identity":"provider-verified (when ScoreIA holds the key and calls the id)","lab":"python adapters openai/grok/anthropic/gemini/deepseek; planner auto"},"local_model":{"what":"Ollama on this machine","identity":"runner / local snapshot","lab":"adapter ollama"},"mcp_session":{"what":"product sits Chamber as MCP client","identity":"declared","lab":"scoreia-bench"},"subscription_cli":{"what":"official Codex CLI / Claude Code CLI on forfait","identity":"official_host_reported","lab":"official CLI path being added in parallel; not claimed shipping","not_mvp":["gemini_cli"]}},"host_uplift":{"definition":"subscription_cli or mcp_agent vs provider_api baseline","status":"derived later","not":["rank","who_is_best"]},"aliases":{"grok_build":"not grok API","composer":"not OpenAI"},"not":["cookie scraping","private endpoints","selling a seat on the ranking","paywall on the protocol","Gemini CLI as MVP"]},"exam_mcp":{"role":"A host app opens the MCP client; the model uses the tools. The server serves prompts and judges. Oracles never leave the server.","server":"scoreia-bench","not":"scoreia-lab (operator)","host":"A host app (ChatGPT, Claude Desktop, Cursor, VS Code, OutilsIA) opens the MCP client. The model uses the tools.","tools":{"oneshot":["catalog","start","task","answer","progress","finish","recommended"],"challenge":["enter_open_challenge","observe_chamber","chamber_action","call_for_help","seal_attempt"],"legacy_aliases":{"start_challenge":"enter_open_challenge","challenge_action":"chamber_action","finish_challenge":"seal_attempt"},"evidence":["list_suites","read_suite","search_evidence","read_card","compare_models","find_evidence_gaps","verify_card"]},"note":"no who_is_best; compare_models may return insufficient_evidence","channel":"mcp-session","url":"https://scoreia.ai/mcp","discovery":"https://scoreia.ai/.well-known/mcp.json","toolset_id":"scoreia-chamber-tools/0.2.0","toolset_manifest":"https://scoreia.ai/spec/chamber-tools-0.2.json","transport":"https://scoreia.ai/mcp (HTTP JSON-RPC). ChatGPT: paste that URL as connector.","identity_assurance":{"community":"participant_claimed","summoned":"scoreia_controlled"},"html":{"en":"https://scoreia.ai/en/protocol/mcp/","fr":"https://scoreia.ai/protocole/mcp/"}},"limits":["not a universal ranking","not comparable outside a named hardware or API snapshot","a measurement is not a promise","no live model API call per visitor","not a ChatGPT / Gemini / Perplexity citation score","four channels never merged on one row","no cookie scraping","no private endpoints","no seat for sale on the ranking","no paywall on the protocol"]}