3GitHub Trending (AI/LLM filtered)·
LLM Gateway: open-source unified API router for multiple LLM providers
LLM Gateway is an open-source TypeScript project that provides a unified API interface for routing, managing, and analyzing LLM requests across multiple providers. The repository has accumulated 1,457 GitHub stars. It addresses the practical problem of multi-provider LLM orchestration in production deployments.
Related guides (2)
Related events (8)
freellmapi: OpenAI-compatible proxy aggregating free tiers of 16 LLM providers
A TypeScript project on GitHub implements an OpenAI-compatible proxy that routes requests across the free tiers of 16 LLM providers, offering approximately 1.7B tokens/month through a single /v1 endpoint. Features include smart routing, automatic failover, and encrypted key storage. The project is positioned for personal experimentation and has gained significant traction with over 11,000 stars, including 226 in a single day.
LiteLLM AI gateway trending: 50K stars, unified interface for 100+ LLM APIs
LiteLLM is a Python SDK and proxy server providing a unified OpenAI-compatible interface to 100+ LLM APIs including Bedrock, Azure, OpenAI, VertexAI, Anthropic, and others. It includes cost tracking, guardrails, load balancing, and logging. The project is trending on GitHub with ~50K total stars and 141 new stars today, signaling continued strong adoption as an AI gateway layer.
free-llm-api-resources: Curated List of Free LLM API Inference Endpoints
A GitHub repository maintained by cheahjs catalogues free LLM inference resources accessible via API, accumulating over 22,000 stars with 89 added today. The project serves as a community reference for developers seeking zero-cost access to hosted language model endpoints. High star count signals broad practitioner interest in inference cost reduction and accessible model APIs.
Langfuse: Open Source LLM Engineering Platform Trending on GitHub
Langfuse is an open-source LLM engineering platform providing observability, metrics, evaluations, prompt management, and dataset tooling. It integrates with OpenTelemetry, LangChain, OpenAI SDK, and LiteLLM. The project has accumulated 28,075 GitHub stars with 89 new stars today, indicating sustained community traction. Backed by Y Combinator (W23), it represents a notable entry in the LLM ops/tooling ecosystem.
vLLM: High-Throughput LLM Inference and Serving Engine Trending on GitHub
vLLM is an open-source Python library providing high-throughput and memory-efficient inference and serving for large language models. The project has accumulated over 80,500 GitHub stars with 98 new stars today, indicating continued strong community interest. It is a widely adopted inference backend in the AI/ML ecosystem, supporting PagedAttention and various optimization techniques for LLM deployment.
RubyLLM: A Ruby framework for integrating major AI providers
RubyLLM is a Ruby framework providing a unified interface to major AI providers, announced via a Hacker News post with 308 upvotes and 47 comments. The project targets Ruby developers who want to integrate LLM capabilities without managing provider-specific APIs. Community engagement suggests meaningful interest from the Ruby ecosystem.
OpenAI announces Open Responses: open-source spec for multi-provider LLM interfaces
OpenAI announced Open Responses, an open-source specification for multi-provider, interoperable LLM interfaces derived from the original OpenAI Responses API. The specification aims to standardize how applications interact with LLMs across different providers. This is a potential standardization move that could shape how the broader ecosystem builds on top of LLM APIs.
LLM Wiki: desktop app that builds persistent knowledge bases from documents using LLMs
LLM Wiki is an open-source cross-platform desktop application that uses LLMs to incrementally build and maintain a persistent, interlinked wiki from user documents rather than performing retrieval-augmented generation on each query. The project has accumulated 12,217 GitHub stars with 111 added today, suggesting notable community traction. It represents an alternative architectural pattern to standard RAG pipelines.