technique
human-LLM collaborative annotation
techniqueactiveprovisional
human-llm-collaborative-annotation-083c54f1·1 events·first seen 22d agoAliases: human-LLM collaborative annotation
Co-occurring entities
More like this (12)
LLM-augmented clinical NLP pipelineInter-Annotator AgreementLLM-based code change labeling pipelineAudio-LLMFrom Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech AnnotationSpeechLLMLLM-based content classificationannotator disagreementDep-LLMMeasuring Human Value Expression in Social Media Texts: Calibrated LLM Annotation and Encoder TransferLLM inferenceLLMScan
Recent events (1)
WhoSaidIt: Human-LLM Collaborative Annotation for Multilingual Speaker-Attribute Classification
This paper proposes a human-LLM collaborative re-annotation framework for stabilizing noisy multilingual speaker-attribute labels under resource constraints. LLMs surface recurring annotation rationales through iterative expert interaction, combined with disagreement-focused sampling for targeted re-annotation. The resulting WhoSaidIt dataset covers nine speaker-attribute labels across multiple languages. Benchmarking of recent LLMs reveals substantial cross-lingual annotation divergence and highlights both capabilities and limitations of LLMs in this classification task.