ACL

Multilayer taxonomy of 14 capability domains and 91 subskills for LLM evaluation

Researchers introduce a structured taxonomy organizing LLM capabilities into 14 domains and 91 subskills across Primitive, Constructed, and Integrative layers, grounded in human cognitive science rather than model architecture. To validate the framework, they screened 31,505 papers from ACL, AAAI, ICML, and NeurIPS (2023–2025) and mapped 15,934 LLM-focused papers through multi-model annotation. The analysis reveals heavy concentration of research attention on Language-Semantic Competence and Reasoning, with six domains receiving fewer than 2% of papers, highlighting systematic coverage gaps. The taxonomy is intended to support cross-study comparison, coverage audits, and hypothesis generation for training and transfer.