Hiddenbench¶
Deciding when the facts are distributed
A hidden-profile task: the information needed to reach the correct answer is split across the participants, and no single agent holds enough to identify it alone. The answer is recoverable only if the private facts that rule out the alternatives are surfaced.
This is the hardest shape CONCORD encounters, because the disagreement is not about judgement but about which facts each agent can see.
Hiddenbench — an evacuation-site decision under distributed information
Watch the recording · 720p · 4 min · 12 MB
What to watch for¶
- Every opening position is reasonable on the information its author holds.
- Agreement is reached on the shared evidence, not on the loudest position.
Certified is not correct
These tasks are the one case in the benchmark where a ground truth exists. CONCORD certifies that every agent cleared its satisfaction floor; that is a different claim from having chosen the right site.