Databricks + Hugging Face Integration Achieves Up to 40% Faster LLM Training and Tuning
Databricks and Hugging Face have published a case study describing their integration that delivers up to 40% faster training and fine-tuning of large language models. The collaboration leverages Databricks' distributed compute infrastructure alongside Hugging Face's model hub and training libraries. This represents a practical infrastructure optimization for enterprise teams running LLM workloads on Databricks.
Related guides (3)
Related events (8)
Fine-tune Any LLM from the Hugging Face Hub with Together AI
Together AI has announced an integration with Hugging Face that enables fine-tuning of any model from the Hugging Face Hub directly through Together AI's platform. This partnership expands access to fine-tuning infrastructure for open-weight models without requiring users to manage their own compute. The integration targets developers and enterprises seeking managed fine-tuning workflows for a broad range of open-source LLMs.
Improving Hugging Face Model Access for Kaggle Users
Hugging Face has announced an integration improvement that streamlines how Kaggle users access models from the Hugging Face Hub. The update appears to reduce friction for practitioners using Kaggle notebooks and compute environments to work with Hugging Face-hosted models. This represents a platform-level partnership move between two major ML community hubs.
Accelerate a World of LLMs on Hugging Face with NVIDIA NIM
NVIDIA NIM microservices are being integrated with Hugging Face to enable optimized inference deployment for a broad range of LLMs hosted on the Hub. The partnership allows developers to deploy Hugging Face models via NIM's containerized inference stack, leveraging NVIDIA's TensorRT-LLM and other optimizations. This expands the ecosystem of models accessible through NIM beyond NVIDIA's own catalog to the wider Hugging Face model repository.
Falcon LLM Integrated into Hugging Face Ecosystem
Hugging Face announced the integration of the Falcon language models (Falcon-7B and Falcon-40B) into its ecosystem, including model hosting, inference APIs, and tooling support. Falcon, developed by the Technology Innovation Institute (TII), had recently topped the Open LLM Leaderboard at the time of release. The post covers usage patterns, fine-tuning guidance, and deployment options within the Hugging Face stack.
Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face
Hugging Face is hosting the Artificial Analysis LLM Performance Leaderboard, which tracks inference performance metrics such as latency, throughput, and cost across multiple LLM providers. The leaderboard provides a standardized comparison of how different models perform in production deployment contexts rather than purely capability benchmarks. This collaboration brings infrastructure and deployment performance data into the Hugging Face ecosystem.
Deploy LLMs with Hugging Face Inference Endpoints
Hugging Face published a guide on deploying large language models using their Inference Endpoints service. The post covers how to set up scalable, production-ready LLM deployments with minimal infrastructure overhead. It targets developers looking to move from experimentation to hosted inference without managing raw compute.
Streaming Datasets: 100x More Efficient
Hugging Face published a blog post describing efficiency improvements to their datasets streaming functionality, claiming up to 100x gains. The post covers technical changes to how large datasets are accessed and loaded without full downloads. This is relevant to ML practitioners working with large-scale training data pipelines.
Deploy Hugging Face Models Easily with Amazon SageMaker
Hugging Face and Amazon SageMaker announced an integration enabling streamlined deployment of Hugging Face models via SageMaker's managed infrastructure. The partnership provides dedicated Hugging Face Deep Learning Containers on AWS, simplifying the path from model hub to production inference. This represents an early milestone in the enterprise deployment pattern of hosted model hubs integrating with cloud ML platforms.