
grok-1d71364b·7 events·first seen Aliases: Grok
Researchers tested four major LLM families (Claude, Grok, GPT, Gemini) on their evaluation of ethnonationalist pseudo-science across four temporal snapshots and two interface types (API vs. web). Grok's Fast versions consistently rated the pseudo-scientific claims 2-5x more credible than other models, and a silent overnight patch reversed Grok's behavior without public documentation; the same model identifier produced radically divergent scores via API versus web three months later. The paper argues that a model's epistemic stance is not a stable property of its weights but a contingent effect of deployment configuration—system prompts, safety layers, interface routing, and undocumented updates—constituting an accountability gap for users and researchers.
A large-scale arXiv study audits political neutrality in Grokipedia—an encyclopedia generated by xAI's Grok LLM—versus Wikipedia, analyzing 1,394 article pairs about government members across nine ideology dimensions using four LLM judges (Grok, Claude, Mistral, DeepSeek). All four judges, including Grok itself, rate Grokipedia as less neutral than Wikipedia. The study finds Grokipedia favors economically right-wing politicians and penalizes socially liberal ones, while Wikipedia shows the opposite bias pattern, raising questions about whether LLM-generated content can deliver ideological neutrality.
Researchers introduce the One-Word Census, a minimal 31-prompt instrument that probes which one-word answers language models select from open-ended categories, applied to 44 models. Convergence is extreme — 41% of models chose 'serendipity' when asked to pick any word — yet conformity varies fourfold across models in structured ways: persona- and community-tuned models diverge most, while newest mainline flagships conform most. Within four model lineages (Claude, GPT, Qwen, Grok), conformity rises with each generation but reverses for the latest Claude and GPT flagships, suggesting possible repositioning. The field is more lexically concentrated than human norms in 18 of 20 shared categories.
The U.S. Department of War designated Anthropic a supply-chain risk to national security after the company refused to remove restrictions on Claude's use for domestic surveillance and autonomous weapons, effectively banning it from military and contractor use. OpenAI signed a contract allowing use of its models 'for all lawful purposes' with ambiguous carve-outs for surveillance and autonomous weapons, which Altman later called rushed and renegotiated. The standoff culminated in a Trump Truth Social post threatening civil and criminal consequences against Anthropic, followed by Hegseth's formal designation. The episode marks a significant precedent: the supply-chain risk designation, previously applied only to foreign companies, was used against a U.S. AI lab over its own usage policies.
Deep Eye is an open-source Python tool that orchestrates multiple AI providers (OpenAI, Claude, Grok, Gemini, Ollama, Groq, Mistral, and others) to generate attack payloads and scan targets for 45+ vulnerability types. It produces professional security reports with compliance mapping. The project has accumulated 1,572 GitHub stars with 42 added today, indicating growing community interest in AI-augmented offensive security tooling.
This paper compares three prompt design strategies—raw prompts, checklist-improved prompts, and clarifying-question prompts—across four task types and three LLM systems (ChatGPT, Claude, Grok). Checklist-improved prompts achieved the highest mean rubric score (7.50/8) versus 5.67 for raw and 6.67 for clarifying-question prompts. Checklist prompts also used fewer tokens on average, suggesting a favorable quality-effort tradeoff. The study provides empirical grounding for structured prompt engineering as a practical technique to reduce multi-turn interaction overhead.
This paper demonstrates empirically that LLMs from multiple model families introduce directional biases when editing human-written texts on contested topics (e.g., nudging toward gun control, against atheism). The authors develop a mathematical opinion-dynamics model showing these biases are amplified through social networks, shifting collective opinion at scale. An audit of X's 'Explain this post' feature finds evidence of pro-life bias in Grok's outputs on abortion content, traced to specific design choices. The paper concludes with implications for EU legislative efforts on AI-mediated communication.