Every answer on this page is a real choice request to the
OpenCodifier engine compiled to WASM in your tab: the question goes in the
state, your options go in as candidates, and what comes back is a pick with
a confidence report and a deterministic execution trace. The deck carries
the keyed answers; the engine's pick is shown next to them and agreement is
scored honestly — the engine can be wrong, and the scoreboard says so.
Abstention is counted as its own outcome, never upscored.
What decides what
Every answer is a real request. No local simulation
dressed up as engine output — the same wire contract the server
runtime speaks: state, question, candidates, policy. The response's
answers, confidence, metrics, and trace are what you see.
Abstention is an outcome. When the runtime refuses
to guess, the row says "abstained" — it is never scored wrong, and
the abstain rate is displayed next to accuracy.
The keyed answer travels with the deck. Agreement
is scored honestly: right, wrong, abstained — and in compete mode you
answer first, then the engine gets the identical question.
Your decks are yours. The JSON editor validates
(2–6 options, exactly one keyed, non-empty text) and rejects the rest
with reasons. Saving is an explicit click and writes this browser's
localStorage only — the site has no server.
Honest edges
The engine will lose. Its rungs are deterministic text reasoning —
zero ML — so the misses, low-confidence guesses, and abstentions ARE
the demo. The confidence report sits right next to every wrong answer.
If the engine is unavailable, runs still finish — the rows are
labelled "engine unavailable" and counted, never silently dropped.
The scoreboard is session-only: close the tab and it is gone. The
deck save is the page's one opt-in exception, labelled local-only.
Question order is seeded — the same seed replays the same run, so
what you audit can be replayed exactly.