4Hugging Face Blog·
Hugging Face integrates vLLM server deployment into HF Jobs with single command
Hugging Face published a guide showing how to launch a vLLM inference server using HF Jobs in a single command. The integration simplifies self-hosted LLM inference deployment on Hugging Face infrastructure. This lowers the operational barrier for practitioners who want managed, scalable vLLM serving without custom orchestration.
Related guides (3)
Related events (8)
Deploy LLMs with Hugging Face Inference Endpoints
Hugging Face published a guide on deploying large language models using their Inference Endpoints service. The post covers how to set up scalable, production-ready LLM deployments with minimal infrastructure overhead. It targets developers looking to move from experimentation to hosted inference without managing raw compute.
Falcon LLM Integrated into Hugging Face Ecosystem
Hugging Face announced the integration of the Falcon language models (Falcon-7B and Falcon-40B) into its ecosystem, including model hosting, inference APIs, and tooling support. Falcon, developed by the Technology Innovation Institute (TII), had recently topped the Open LLM Leaderboard at the time of release. The post covers usage patterns, fine-tuning guidance, and deployment options within the Hugging Face stack.
Hugging Face redesigns hf CLI to be agent-optimized for Hub interactions
Hugging Face published a blog post describing design decisions behind making the hf CLI agent-friendly for interacting with the Hub. The post covers how the CLI is being structured to work well in agentic workflows where LLMs or automated systems issue commands programmatically. This is relevant to the growing ecosystem of AI agents that need to retrieve, upload, or manage models and datasets.
Hugging Face and FriendliAI Partner to Supercharge Model Deployment on the Hub
Hugging Face and FriendliAI have announced a partnership to integrate FriendliAI's inference infrastructure directly into the Hugging Face Hub. The collaboration aims to simplify and accelerate model deployment for developers accessing models through the Hub. This expands the ecosystem of inference providers available on Hugging Face's platform.
Hugging Face Launches Inference Providers on the Hub
Hugging Face has introduced Inference Providers on the Hub, a feature that allows users to run models hosted on the Hub through third-party inference providers directly from the platform. This integration consolidates access to multiple inference backends under a unified interface, reducing friction for developers who want to deploy or test models at scale. The announcement positions Hugging Face as a marketplace layer connecting model authors with inference infrastructure providers.
Building the Hugging Face MCP Server
Hugging Face has published a blog post describing the construction of an MCP (Model Context Protocol) server that exposes Hugging Face platform capabilities to AI agents and LLM toolchains. The post covers the architecture and implementation of the server, enabling agents to search models, datasets, and spaces programmatically. This represents Hugging Face's integration into the emerging MCP ecosystem for agent-tool interoperability.
Hugging Face introduces native-speed vLLM transformers modeling backend
Hugging Face announced a native-speed backend integration between vLLM and the Transformers library, enabling vLLM to use Transformers model implementations directly at native inference speed. This removes the need to maintain separate model code in vLLM, broadening model coverage and simplifying the ecosystem. The integration is significant for practitioners deploying open-weights models at scale, as it reduces friction between the two dominant open-source inference stacks.
Accelerate a World of LLMs on Hugging Face with NVIDIA NIM
NVIDIA NIM microservices are being integrated with Hugging Face to enable optimized inference deployment for a broad range of LLMs hosted on the Hub. The partnership allows developers to deploy Hugging Face models via NIM's containerized inference stack, leveraging NVIDIA's TensorRT-LLM and other optimizations. This expands the ecosystem of models accessible through NIM beyond NVIDIA's own catalog to the wider Hugging Face model repository.