NVIDIA Model-Optimizer

NVIDIA Model-Optimizer: unified library for quantization, pruning, distillation, and inference optimization

NVIDIA's Model-Optimizer is an open-source Python library consolidating state-of-the-art model compression techniques including quantization, distillation, pruning, neural architecture search, and speculative decoding. It targets downstream deployment on TensorRT-LLM, TensorRT, and vLLM to improve inference speed. The repository has accumulated 3,286 stars with modest recent activity (+8 today).