4Hugging Face Blog·
Hugging Face experiments with Cross-Origin Storage API in Transformers.js
Hugging Face published a blog post exploring the proposed Cross-Origin Storage API and its application within Transformers.js, their JavaScript inference library. The post documents experimental work on enabling cross-origin model storage access in browser-based AI inference. This is relevant to the web-based AI deployment ecosystem, potentially reducing redundant model downloads across origins.
Related guides (3)
Related events (8)
Accelerating Hugging Face Transformers with AWS Inferentia2
Hugging Face published a blog post detailing how to accelerate Transformer model inference using AWS Inferentia2, Amazon's second-generation ML inference chip. The post covers integration patterns between the Hugging Face ecosystem and the Neuron SDK for deploying models on Inferentia2 hardware. This represents a practical guide for enterprise and cloud-based inference deployment using dedicated AI accelerators.
How Hugging Face Sped Up Transformer Inference 100x for API Customers
Hugging Face describes engineering optimizations that achieved up to 100x speedups in transformer inference for their hosted API customers. The post covers techniques applied to accelerate model serving at scale. This is a 2021 article documenting early inference optimization work at Hugging Face's inference API product.
Making ML-powered web games with Transformers.js
This Hugging Face blog post demonstrates how to build machine learning-powered web games using Transformers.js, enabling in-browser inference without a server backend. The post covers practical implementation patterns for running transformer models directly in the browser via WebAssembly and WebGL. It serves as both a tutorial and a showcase of client-side ML deployment capabilities.
Transformers.js v3: WebGPU Support, New Models & Tasks, and More
Hugging Face released Transformers.js v3, a major update to its JavaScript inference library enabling on-device ML in browsers and Node.js. The release adds WebGPU backend support for hardware-accelerated inference, expands the supported model and task catalog, and improves overall performance. This brings browser-side AI inference closer to parity with native runtimes for a wider range of use cases.
Transformers.js v4: Now Available on NPM
Hugging Face has released Transformers.js v4, a major version update to its JavaScript library for running transformer models in the browser and Node.js, now published on NPM. The release likely includes updated model support, performance improvements, and API changes. This continues the trend of bringing ML inference capabilities directly to JavaScript environments without requiring a Python backend.
Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers
A Hugging Face blog post discusses inference optimization techniques derived from OpenAI's gpt-oss codebase that can be applied within the Hugging Face Transformers library. The post appears to cover practical tricks for improving transformer inference speed or efficiency. As a tier-2 source with commentary depth, this is a practitioner-oriented technical guide bridging OpenAI's internal methods and the open-source ecosystem.
Hugging Face Transformers library trending on GitHub
The Hugging Face Transformers library appeared in GitHub trending with 162,137 total stars and 46 new stars on the day. Transformers is a foundational open-source framework supporting state-of-the-art models across text, vision, audio, and multimodal tasks for both inference and training. No specific release or update is described in this signal.
Habana Labs and Hugging Face Partner to Accelerate Transformer Model Training
Habana Labs and Hugging Face announced a partnership to accelerate transformer model training on Habana's Gaudi AI processors. The collaboration aims to integrate Hugging Face's Transformers library with Habana's hardware, offering an alternative to GPU-based training infrastructure. This represents an early effort to diversify the AI training hardware ecosystem beyond NVIDIA dominance.