Making thousands of open LLMs bloom in the Vertex AI Model Garden
Hugging Face and Google Cloud announced an integration bringing thousands of open-source LLMs from the Hugging Face Hub into Vertex AI Model Garden. This partnership allows developers to deploy open-weight models directly through Google Cloud's managed infrastructure. The collaboration represents a significant expansion of enterprise-accessible open model deployment options on a major cloud platform.
Related guides (4)
Related events (8)
Hugging Face and Google Partner for Open AI Collaboration
Hugging Face and Google have announced a partnership focused on open AI collaboration, expanding access to Hugging Face models and tools on Google Cloud Platform. The deal deepens integration between Hugging Face's model hub and Google's cloud infrastructure, enabling easier deployment of open-source models via GCP services. This follows a pattern of major cloud providers forming strategic alliances with leading open-source AI platforms.
Hugging Face and Google Cloud Announce New Partnership
Hugging Face has announced a new partnership with Google Cloud, framed around building an open AI future. The blog post outlines collaboration between the two organizations, though the body content is not provided. This partnership likely involves deeper integration of Hugging Face's open-weights model hub and tooling with Google Cloud's infrastructure and services.
Deploy Meta Llama 3.1 405B on Google Cloud Vertex AI
Hugging Face published a guide detailing how to deploy Meta's Llama 3.1 405B model on Google Cloud Vertex AI. The post covers infrastructure setup, serving configuration, and integration patterns for running the large open-weights model in a managed cloud environment. This reflects the growing ecosystem of tooling and cloud partnerships enabling enterprise deployment of frontier open-weights models.
Welcome Gemma - Google's new open LLM
Google released Gemma, a family of open-weight large language models, announced via the Hugging Face blog. The models are positioned as Google's entry into the open-weights LLM space, following the success of models like Llama 2. This release marks a significant strategic move by Google to compete in the open-source AI ecosystem.
Welcome Gemma 2 - Google's new open LLM
Google released Gemma 2, a new open-weights large language model, announced via the Hugging Face blog. The post covers integration with the Hugging Face ecosystem and highlights the model's capabilities. Gemma 2 represents Google's continued investment in open-weight model releases to compete in the open-source LLM space.
Fine-tune Any LLM from the Hugging Face Hub with Together AI
Together AI has announced an integration with Hugging Face that enables fine-tuning of any model from the Hugging Face Hub directly through Together AI's platform. This partnership expands access to fine-tuning infrastructure for open-weight models without requiring users to manage their own compute. The integration targets developers and enterprises seeking managed fine-tuning workflows for a broad range of open-source LLMs.
Accelerate a World of LLMs on Hugging Face with NVIDIA NIM
NVIDIA NIM microservices are being integrated with Hugging Face to enable optimized inference deployment for a broad range of LLMs hosted on the Hub. The partnership allows developers to deploy Hugging Face models via NIM's containerized inference stack, leveraging NVIDIA's TensorRT-LLM and other optimizations. This expands the ecosystem of models accessible through NIM beyond NVIDIA's own catalog to the wider Hugging Face model repository.
Falcon LLM Integrated into Hugging Face Ecosystem
Hugging Face announced the integration of the Falcon language models (Falcon-7B and Falcon-40B) into its ecosystem, including model hosting, inference APIs, and tooling support. Falcon, developed by the Technology Innovation Institute (TII), had recently topped the Open LLM Leaderboard at the time of release. The post covers usage patterns, fine-tuning guidance, and deployment options within the Hugging Face stack.