LiteLLM AI gateway trending: 50K stars, unified interface for 100+ LLM APIs
LiteLLM is a Python SDK and proxy server providing a unified OpenAI-compatible interface to 100+ LLM APIs including Bedrock, Azure, OpenAI, VertexAI, Anthropic, and others. It includes cost tracking, guardrails, load balancing, and logging. The project is trending on GitHub with ~50K total stars and 141 new stars today, signaling continued strong adoption as an AI gateway layer.
Related guides (4)
Related events (8)
vLLM: High-Throughput LLM Inference and Serving Engine Trending on GitHub
vLLM is an open-source Python library providing high-throughput and memory-efficient inference and serving for large language models. The project has accumulated over 80,500 GitHub stars with 98 new stars today, indicating continued strong community interest. It is a widely adopted inference backend in the AI/ML ecosystem, supporting PagedAttention and various optimization techniques for LLM deployment.
awesome-llm-apps: 100+ Runnable AI Agent & RAG Application Examples
A curated GitHub repository collecting over 100 deployable AI agent and RAG (Retrieval-Augmented Generation) applications built with LLMs. The collection is designed for practical use — clone, customize, and ship. With 110,915 total stars and 202 added today, it reflects strong community interest in applied LLM tooling.
free-llm-api-resources: Curated List of Free LLM API Inference Endpoints
A GitHub repository maintained by cheahjs catalogues free LLM inference resources accessible via API, accumulating over 22,000 stars with 89 added today. The project serves as a community reference for developers seeking zero-cost access to hosted language model endpoints. High star count signals broad practitioner interest in inference cost reduction and accessible model APIs.
earendil-works/pi: AI Agent Toolkit with Coding Agent CLI, Unified LLM API, and Multi-UI Libraries
The earendil-works/pi repository is an open-source TypeScript toolkit providing a coding agent CLI, unified LLM API abstraction, TUI and web UI libraries, a Slack bot integration, and vLLM pod support. It has accumulated 53,875 GitHub stars with 444 new stars today, indicating significant community traction. The project spans multiple components of the agent-tool ecosystem including inference backends and developer-facing interfaces.
MLflow trending on GitHub as open-source AI engineering platform
MLflow, an open-source platform for managing AI/ML workflows, is trending on GitHub with 26,442 total stars and 22 new stars today. The project supports agents, LLMs, and traditional ML models, offering debugging, evaluation, monitoring, and optimization capabilities for production AI applications. It is a mature, widely-used tooling platform in the MLOps space.
Crawl4AI: Open-Source LLM-Friendly Web Crawler & Scraper
Crawl4AI is an open-source Python library designed to make web crawling and scraping compatible with LLM pipelines. The project has accumulated over 66,500 GitHub stars with strong daily momentum (+216 today), indicating significant community adoption. It targets the data ingestion layer for AI agents and RAG systems that require structured web content.
mlx-lm: LLM inference library for Apple MLX framework trending on GitHub
mlx-lm is an open-source Python library for running LLMs using Apple's MLX framework, designed for Apple Silicon hardware. The repository has accumulated 5,817 stars with 43 new stars today, indicating steady community interest. It represents a key piece of the Apple-native ML inference ecosystem.
Langfuse: Open Source LLM Engineering Platform Trending on GitHub
Langfuse is an open-source LLM engineering platform providing observability, metrics, evaluations, prompt management, and dataset tooling. It integrates with OpenTelemetry, LangChain, OpenAI SDK, and LiteLLM. The project has accumulated 28,075 GitHub stars with 89 new stars today, indicating sustained community traction. Backed by Y Combinator (W23), it represents a notable entry in the LLM ops/tooling ecosystem.