Optimum-Intel
optimum-intel-9651c983·6 events·first seen 28d agoAliases: Optimum-Intel, Optimum Intel
Co-occurring entities
More like this (12)
Recent events (6)
Optimize and Deploy with Optimum-Intel and OpenVINO GenAI
Hugging Face's Optimum-Intel library integrates with Intel's OpenVINO runtime to enable optimized inference of generative AI models on Intel hardware. The post covers quantization, model export, and deployment workflows using OpenVINO GenAI APIs. This targets edge and CPU-based inference scenarios where reducing model size and latency is critical.
Accelerate your models with Optimum Intel and OpenVINO
Hugging Face's Optimum Intel library integrates with Intel's OpenVINO toolkit to accelerate inference of transformer models on Intel hardware. The post covers how to export models to OpenVINO IR format and run optimized inference pipelines. This targets deployment efficiency for NLP and vision models on CPU and other Intel accelerators.
Blazing Fast SetFit Inference with Optimum Intel on Xeon
Hugging Face demonstrates accelerated inference for SetFit few-shot text classification models using Optimum Intel on Intel Xeon CPUs. The post covers optimization techniques such as quantization and ONNX export to improve throughput and latency for CPU-based deployment. This is relevant to practitioners deploying lightweight NLP models in cost-sensitive or edge environments without GPU hardware.
CPU Optimized Embeddings with Optimum Intel and fastRAG
Hugging Face and Intel demonstrate CPU-optimized embedding inference using Optimum Intel and fastRAG, targeting RAG pipeline acceleration without GPU hardware. The post covers quantization and optimization techniques that improve embedding throughput on Intel CPUs. This is relevant to inference economics and enterprise deployment patterns where GPU availability is constrained.
Accelerate StarCoder with Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding
Hugging Face and Intel demonstrate quantization (INT8/INT4) and speculative decoding techniques applied to StarCoder on Intel Xeon CPUs using the Optimum Intel library. The post covers practical inference acceleration workflows targeting CPU deployment of code generation models. This represents a concrete inference-economics use case for open-weight code models on commodity server hardware.
Fine-tuning Stable Diffusion models on Intel CPUs
This Hugging Face blog post describes a workflow for fine-tuning Stable Diffusion image generation models on Intel CPUs rather than GPUs. It covers the tooling and optimizations required to make CPU-based diffusion model training practical, relevant to inference-economics and hardware diversification trends. The post targets practitioners looking to reduce dependency on GPU hardware for generative model fine-tuning.