wildtrace-7d0475a4·1 events·first seen Aliases: WILDTRACE
WILDTRACE is a new benchmark of 481 tasks over 214 naturally occurring long-form documents—including technical incident reports and literary narratives—designed to test whether models can integrate evidence dispersed across distant passages by the document's own logic. The benchmark defines seven source-internal evidence geometries grounded in Pearl's causal hierarchy and multi-hop reasoning typologies, and uses a source-first construction pipeline with multi-stage validation to avoid the distributional artifacts common in existing long-context benchmarks. The work targets a gap between retrieving information and genuinely reasoning over naturally structured evidence, which the authors argue is a defining challenge for next-generation long-context systems.