technique

SVD-LLM

techniqueactiveprovisionalsvd-llm-ea95a275·1 events·first seen 5d ago

Aliases: SVD-LLM

Co-occurring entities

LLaMA-7B Optimal Brain Surgeon SVD-Surgeon OPT

More like this (12)

SpeechLLM vLLM Dep-LLM Audio-LLM LLMScan LLM Wiki frontier LLMs whichllm SVD-Surgeon LLM (CLI tool)LLM electronic warfare LLM

Recent events (1)

4arXiv · cs.CL·5d ago·source ↗

SVD-Surgeon: Training-free optimal singular value compensation for LLM compression

SVD-Surgeon applies the Optimal Brain Surgeon (OBS) framework to singular-value decomposition-based LLM compression, computing closed-form updates to retained singular values that compensate for pruned ones to second order in the model loss. The method is training-free and modular, designed to layer on top of existing SVD compressors. Applied to SVD-LLM on OPT and LLaMA 2-7B, it improves the perplexity-compression trade-off without retraining.

Open Weights Progress Inference Economics SVD-LLM LLaMA-7B Optimal Brain Surgeon +2 more