Almanac
technique

LoRA (Low-Rank Adaptation)

techniqueactiveprovisionallora-low-rank-adaptation--434ed472·2 events·first seen 15d ago

Aliases: LoRA (Low-Rank Adaptation), Low-Rank Adaptation

Co-occurring entities

More like this (12)

Recent events (2)

4Mistral Ai News·15d ago·source ↗

Mistral AI Demonstrates Pixtral-12B Fine-Tuning on Satellite Imagery via LoRA

Mistral AI published a technical case study showing how fine-tuning Pixtral-12B using LoRA on the Aerial Image Dataset (AID) significantly improves satellite image classification over the base model. The post details the fine-tuning workflow via Mistral's API and LaPlateforme UI, covering hyperparameter selection and structured output enforcement. Key improvements include better handling of ambiguous scene categories (e.g., Playground vs. Stadium) and reduced hallucination of invalid class labels. The article positions domain-specific fine-tuning as a practical bridge between general-purpose vision-language models and specialized geospatial applications.

3arXiv · cs.CL·6d ago·source ↗

PoetryQwen: LoRA-fine-tuned Qwen2.5-14B for classical Chinese poetry understanding with new 49K dataset

Researchers introduce CCPoetry-49K, a 49,404-pair instruction dataset for classical Chinese poetry appreciation, decomposed into term interpretation, semantic interpretation, and emotional inference subtasks. They fine-tune Qwen2.5-14B using LoRA to produce PoetryQwen, achieving a 9.7% improvement over the baseline on the CCL25-Eval Task 5 benchmark (0.757 vs 0.690). The work addresses a gap in domain-specific LLM adaptation for classical Chinese literary tasks.