llama-3-8ae64b01·4 events·first seen Aliases: Llama 3
A new arXiv paper introduces a typology of 17 linguistically motivated expression-of-belief (EoB) types—spanning form, evidentiality, epistemic stance, and tone—to evaluate how phrasing affects whether LLMs defer to user-stated beliefs or their own prior knowledge. The authors benchmark 16 LLMs across Llama 3, Qwen3, and Gemma3 families at scales from 1B to 30B parameters, finding that larger and instruction-tuned models are systematically less context-following than smaller or base models. Specific linguistic framings (e.g., presuppositions, certainty markers) are identified as statistically more persuasive, with implications for prompt robustness and sycophancy research.
Meta released Llama Guard 3 11B Vision on Hugging Face, a multimodal safety classifier supporting image-text-to-text inputs built on the Llama 3 architecture. The model extends the Llama Guard safety classification family to handle visual content alongside text. This is relevant to AI safety tooling for multimodal deployments.
Researchers conduct a sensitivity analysis of both general-purpose and medical-specific LLMs using the MedMCQA benchmark, testing robustness to lexical and syntactic prompt perturbations. The study finds that even minor phrasing changes can alter clinical advice, and adversarial prompts can produce dangerous outputs such as incorrect dosages or omitted critical findings. Both general-purpose models (GPT-3.5, Llama 3) and domain-specific models (ClinicalBERT, BioLlama3, BioBERT) exhibit this fragility, with syntactic reordering and misleading contextual cues proving more destabilizing than simple paraphrasing.
Hugging Face published a blog post welcoming Meta's Llama 3 release, covering the new open-weights large language models. Llama 3 represents a significant update to Meta's open model family, with improved capabilities over Llama 2. The post covers integration and availability on the Hugging Face platform.