technique

LLM inference

techniqueactivellm-inference-4609c4c4·1 events·first seen 28d ago

Aliases: LLM inference

Co-occurring entities

More like this (12)

LLM vLLM LLM-as-a-Judge LLM evaluation LLM (CLI tool)LLM CLI LLM agents whichllm LLM-judge scoring SpeechLLM long-context LLMs Arabic LLMs

Recent events (1)

3Hugging Face Blog·28d ago·source ↗

Continuous Batching from First Principles

A Hugging Face blog post explains the mechanics of continuous batching for LLM inference, covering the foundational concepts from first principles. The post targets practitioners seeking to understand how continuous batching improves GPU utilization and throughput compared to static batching. This is an educational/commentary piece rather than a new capability announcement.

Inference Economics LLM inference Hugging Face continuous batching