decodem-9a1dc5d6·1 events·first seen Aliases: DECODEM
DECODEM introduces benchmark datasets pairing corporate charters and bylaws with human annotations for evaluating automated extraction of governance variables using LLMs. The paper evaluates multiple extraction pipelines varying in prompt design, task decomposition, and document handling, finding frontier models achieve high accuracy on most provisions. A key finding is that elaborate prompting and cascading pipelines do not consistently improve frontier model performance but substantially narrow the gap with smaller efficiency-oriented models, suggesting pipeline design can partially substitute for model capability in structured legal document extraction.