4arXiv cs.AI (Artificial Intelligence)·
Large-scale analysis of AI learning assistant usage across 77,543 distance education students
Researchers present a descriptive analysis of Syntea, an AI-based learning assistant deployed in higher education, using objective log data from 77,543 distance-learning students. The study examines usage patterns across gender, age, study cluster, degree type, and study mode, finding that Syntea is embedded in many learners' routines but with notable demographic variation. The work addresses a gap in educational AI research, which has largely relied on small samples and self-reported data.
Related guides (1)
Related events (8)
Anthropic publishes large-scale study of how university students use Claude
Anthropic analyzed one million anonymized student conversations on Claude.ai to produce one of the first large-scale empirical studies of real-world AI usage in higher education. Key findings: Computer Science students are heavily overrepresented (36.8% of conversations vs. 5.4% of U.S. degrees), while Business, Health, and Humanities students underuse the tool relative to enrollment. Students primarily engage in higher-order cognitive tasks per Bloom's Taxonomy—creating and analyzing—though the study raises concerns about offloading critical thinking. The analysis used Anthropic's internal Clio tool, which aggregates conversation patterns while stripping personal information.
Anthropic Education Report: How Educators Use Claude in Higher Education
Anthropic analyzed ~74,000 anonymized conversations from higher education professionals on Claude.ai during May–June 2025, finding that curriculum development dominates educator AI use (57% of conversations), followed by academic research (13%) and student assessment (7%). Faculty are not only using Claude as a chatbot but also building custom interactive tools via Claude Artifacts, such as chemistry simulations and grading rubrics. The study, complemented by qualitative research with 22 Northeastern University faculty, reveals a spectrum from augmentation (lesson design, advising) to automation (routine administrative tasks), with grading being a contested and relatively rare but automation-heavy use case.
DigitalCoach dataset benchmarks AI agents as human software tutors, revealing grounding and pedagogy gaps
Researchers introduce DigitalCoach, a multimodal dataset of 72 expert-novice computer use coaching sessions comprising 22,752 dialogue turns grounded in 28.1 hours of screen and input recordings across five software applications. The dataset is used to evaluate whether state-of-the-art models can teach humans to use software, finding that models favor direct instructions over explanations, error diagnosis, and knowledge checks. Interactive evaluation shows model coaches cause passive instruction-following rather than deeper engagement, and models perform poorly at visual grounding in screen context. The work establishes a benchmark for developing more collaborative and pedagogically effective computer-use coaching agents.
Pipeline detects curriculum knowledge gaps from student-AI conversational logs using prerequisite graphs
Researchers present a pipeline that classifies student questions directed at a conversational AI teaching assistant into curriculum topics using a few-shot classifier grounded in a GPT-4-extracted prerequisite knowledge graph. Evaluated on 1,340 questions from 164 graduate students, the classifier achieves 80% accuracy across 43 labels. Topic-level question volume significantly correlates with student-reported difficulty (rho=0.491), validating that AI interaction logs carry actionable diagnostic signals about knowledge gaps.
Anthropic Launches Economic Index: First Large-Scale Empirical Study of AI's Labor Market Impact
Anthropic has released the Anthropic Economic Index, an initiative tracking AI's effects on labor markets using anonymized data from approximately one million Claude.ai conversations matched to U.S. Department of Labor O*NET occupational tasks. Key findings show AI use is concentrated in software development and technical writing, with 36% of occupations seeing AI use in at least 25% of their tasks, and usage skewing toward augmentation (57%) over automation (43%). The underlying dataset is being open-sourced to enable independent research, and Anthropic is inviting economists and policy experts to contribute to the ongoing initiative. The analysis was enabled by Clio, Anthropic's privacy-preserving internal conversation analysis tool.
OpenAI and the CSU System Bring ChatGPT to 500,000 Students & Faculty
OpenAI has partnered with the California State University system to deploy ChatGPT to approximately 500,000 students and faculty, described as the largest single deployment of ChatGPT to date. The initiative aims to expand AI use in higher education and develop an AI-ready workforce in the United States. No technical details about the deployment configuration or specific product tier are disclosed in the announcement.
Autodata: Meta-optimized agentic data scientist for high-quality synthetic data generation
Researchers introduce Autodata, a framework that trains AI agents to act as data scientists capable of generating high-quality synthetic training and evaluation data. The method includes a meta-optimization loop (Agentic Self-Instruct) that improves the data scientist agent itself, yielding further performance gains. Experiments on CS research, legal reasoning, and mathematical reasoning tasks show improvements over classical synthetic data methods. The authors frame this as a path to converting inference compute into higher-quality training data.
Anthropic launches Claude for Education with Learning Mode and university partnerships
Anthropic announced Claude for Education, a specialized offering for higher education institutions featuring a new 'Learning mode' that uses Socratic questioning to guide student reasoning rather than providing direct answers. The launch includes campus-wide access agreements with Northeastern University, London School of Economics, and Champlain College, covering 50,000+ students and staff. Anthropic is also joining Internet2, partnering with Instructure to embed Claude in Canvas LMS, and launching student ambassador and API credit programs. The initiative positions Anthropic as a major player in the edtech AI market while introducing a pedagogically-motivated model behavior mode.