4arXiv cs.AI (Artificial Intelligence)·
Large-scale study of user-reported breakdowns in AI healthcare chatbots across 59 apps
Researchers analyzed over 15,000 user reviews from 59 AI healthcare chatbot apps to identify recurring failure modes in real-world deployment. Topic modeling and interpretive analysis surfaced three breakdown categories: access and reliability issues, interaction quality problems, and billing/support failures, with privacy and security concerns correlating with the most negative user experiences. The study frames healthcare chatbots as information infrastructure and draws implications for designers, policymakers, and health information professionals.
Related guides (2)
Related events (8)
Systematic 14-Day Evaluation of Six AI Chatbots as News Intermediaries Across Languages and Regions
Researchers evaluated six commercial AI chatbots (Gemini 3 Flash/Pro, Grok 4, Claude 4.5 Sonnet, GPT-5, GPT-4o mini) on 2,100 factual questions derived from same-day BBC News reporting across six regional services over 14 days in February 2026. Top systems exceed 90% multiple-choice accuracy on breaking news but lose 11-17% under free-response conditions. Key findings include systematic Hindi-language underperformance (79% vs. 89-91% elsewhere) driven by Anglophone retrieval bias, retrieval failures accounting for over 70% of errors, and dramatic accuracy collapse (to 19-70%) on questions containing subtle false premises. A detection-accuracy paradox is identified: the best false-premise detector does not yield the best adversarial accuracy, suggesting premise detection and answer recovery are partially independent capabilities.
Study finds LLM health chatbot triage outcomes vary significantly with patient communication style
Researchers analyzed 2,053 real patient-chatbot conversations and found wide variation in communication patterns and emotional expression, revealing that idealized patient simulations used in chatbot development are inadequate. They built a patient simulator modeling clinical content, emotional state, conversational strategy, and communication style, achieving near-indistinguishability from real conversations (human graders 55% accurate). Evaluating four LLMs across 1,164 clinician-graded cases with five patient personae, the study found that communication style significantly alters triage urgency assessments. The authors warn that systems optimized for cooperative, articulate users risk underperforming and amplifying health disparities in real-world deployment.
EMPATH: Multilingual multi-turn safety benchmark for emotional-support chatbots reveals score inflation and run-to-run reliability failures
EMPATH is a new arXiv benchmark for evaluating the safety of emotional-support chatbots, using an auditor model to generate multi-turn crisis conversations and a calibrated judge model to score transcripts across 19 metrics in five dimensions. Built for Mexican Spanish and US English, the benchmark surfaces score inflation on 10 of 19 metrics under uncalibrated rubrics and finds that run-to-run reliability is a per-model safety property: one model swings 2–10 points on a crisis metric across identical reruns, and DeepSeek V4 Pro produces different conversations at temperature 0. Evaluation of three frontier models shows aggregate scores within 0.74 points but per-metric divergences up to six points, with rankings stable across a cross-family judge at 93% within ±1.
The Batch digest: U.S. chatbot adoption tops 50%, AA-Briefcase benchmark, ARD spec, North Mini Code, Fable/Mythos export controls
A weekly digest from DeepLearning.AI covers five AI developments: a Pew Research Center survey showing nearly half of U.S. adults now use AI chatbots (ChatGPT at 44% adoption); Artificial Analysis releasing AA-Briefcase, a new benchmark for complex knowledge-work tasks where Claude Opus 4.8 is a top performer; Hugging Face publishing a reference implementation of the Agentic Resource Discovery (ARD) open spec co-developed with Microsoft, Google, and others for runtime tool discovery by agents; Cohere releasing North Mini Code, a 30B-parameter open-weight MoE coding model under Apache 2.0; and over 100 cybersecurity professionals signing an open letter urging the U.S. government to reverse export controls on Anthropic's Claude Fable 5 and Claude Mythos 5. The ARD and export-control items are the highest-signal stories, touching agent infrastructure standards and AI regulatory policy respectively.
Introducing ChatGPT Health
OpenAI has launched ChatGPT Health, a dedicated product experience designed to integrate personal health data and third-party health apps into ChatGPT. The product features privacy protections and a physician-informed design, positioning OpenAI as a direct player in the consumer health AI space. This represents a significant vertical expansion of ChatGPT beyond general-purpose assistance.
Your AI Use Is Breaking My Brain
Simon Willison comments on the phenomenon of AI-generated or AI-assisted content degrading the quality of online discourse and information environments. The piece reflects on how widespread AI use is affecting the experience of consuming internet content. This is a commentary piece from a prominent developer/blogger on the social and epistemic effects of AI proliferation.
Early methods for studying affective use and emotional well-being on ChatGPT
OpenAI and MIT Media Lab have published a collaborative research study examining how users engage with ChatGPT in emotionally significant ways and the implications for user well-being. The work represents an early methodological effort to measure and understand affective use patterns on large-scale conversational AI systems. This falls within OpenAI's broader safety and responsible deployment research agenda.
AI Chatbots Are Giving Out People's Real Phone Numbers
Reports are emerging of individuals receiving misdirected calls and messages because generative AI systems, including Google's AI, are surfacing incorrect or misattributed phone numbers in response to user queries. Affected users describe weeks of unwanted contact from strangers seeking unrelated services. The issue highlights a concrete real-world harm from AI hallucination or data contamination in deployed consumer products.