4GitHub Trending (AI/LLM filtered)·
TileLang: domain-specific language for high-performance GPU/CPU/accelerator kernel development
TileLang is an open-source domain-specific language (DSL) aimed at simplifying the development of high-performance compute kernels for GPUs, CPUs, and accelerators. The project is trending on GitHub with 6,871 total stars and 109 new stars today. It is relevant to the AI/ML inference and training infrastructure space, where custom kernel development is a key performance bottleneck.
Related guides (2)
Related events (8)
MLIR-based compilation method for LLM inference on specialized hardware
Researchers present an MLIR-based compiler pipeline for deploying large language models on AI accelerators, using two dialect layers (TopOp for framework-agnostic graph representation and TpuOp for hardware-specific lowering). The method splits each Transformer layer into three static compilation stages (prefill, prefill_kv, decode) to handle the distinct computational profiles of prompt processing and autoregressive generation. The approach is implemented in the open-source TPU-MLIR compiler and LLM-TPU project, supporting Qwen, Llama, InternVL, and MiniCPM-V families with GPTQ, AWQ, and AutoRound quantization.
ktransformers: heterogeneous LLM inference/fine-tune optimization framework gains traction on GitHub
ktransformers is an open-source Python framework for heterogeneous LLM inference and fine-tuning optimizations, developed by kvcache-ai. The project has accumulated 18,236 GitHub stars with 328 added in a single day, indicating significant community interest. It targets KV-cache and mixed-hardware inference optimization, a key area for reducing LLM serving costs.
Introducing Triton: Open-source GPU programming for neural networks
OpenAI released Triton 1.0, an open-source Python-like language for GPU programming targeting neural network workloads. It enables researchers without CUDA expertise to write highly efficient GPU kernels, reportedly matching expert-level performance in most cases. The release lowers the barrier to custom GPU kernel development for ML practitioners.
Accelerating LLM Inference with TGI on Intel Gaudi
Hugging Face's Text Generation Inference (TGI) framework has added a backend for Intel Gaudi accelerators, enabling LLM inference on Intel's AI hardware. The integration allows users to deploy large language models on Gaudi hardware using TGI's serving infrastructure. This expands the hardware ecosystem for LLM inference beyond NVIDIA GPUs, offering an alternative accelerator option for enterprise deployments.
Langfuse: Open Source LLM Engineering Platform Trending on GitHub
Langfuse is an open-source LLM engineering platform providing observability, metrics, evaluations, prompt management, and dataset tooling. It integrates with OpenTelemetry, LangChain, OpenAI SDK, and LiteLLM. The project has accumulated 28,075 GitHub stars with 89 new stars today, indicating sustained community traction. Backed by Y Combinator (W23), it represents a notable entry in the LLM ops/tooling ecosystem.
LitGPT: Lightning AI's multi-LLM pretraining, finetuning, and deployment framework
LitGPT is an open-source Python framework from Lightning AI supporting 20+ high-performance LLMs with recipes for pretraining, finetuning, and large-scale deployment. The repository has accumulated 13,563 GitHub stars with modest daily momentum (+39). It serves as a practitioner-oriented tooling layer for working with open-weights models across the full training and serving lifecycle.
Accelerating Protein Language Model ProtST on Intel Gaudi 2
A Hugging Face blog post details the acceleration of ProtST, a protein language model, on Intel's Gaudi 2 AI accelerator hardware. The post covers the technical integration and performance results of running this specialized biological ML model on Gaudi 2. This represents an intersection of domain-specific AI (protein modeling) and alternative AI hardware ecosystems.
Langflow: Visual AI Agent and Workflow Builder Trending on GitHub
Langflow is an open-source Python framework for building and deploying AI-powered agents and workflows, currently accumulating 148,425 total GitHub stars with 155 new stars today. It provides a visual interface for composing LLM-based pipelines and agent workflows. The continued traction signals ongoing community interest in low-code/visual tooling for AI agent construction.