7The Batch (DeepLearning.AI)·
DeepSeek open-sources DSpark speculative decoding module, achieving 50%+ throughput gains in production
Researchers from Peking University and DeepSeek introduced DSpark, a speculative decoding module that dynamically adjusts verification depth based on server load, achieving 57–85% faster per-user token generation and 51–52% higher total throughput compared to DeepSeek's previous production drafter. The team released checkpoints DeepSeek-V4-Pro-DSpark and DeepSeek-V4-Flash-DSpark on Hugging Face under an MIT license, with the draft module attaching to frozen target model weights. Key innovations include a parallel drafting backbone (adapted from DFlash), a Markov head for sequential token coherence correction, a calibrated confidence head, and a load-aware scheduler that trades draft length against server capacity. Results generalize across model families including Qwen3 and Gemma4.
Related guides (4)
Related events (8)
DeepSeek releases DSpark: speculative decoding system for LLM inference acceleration
DeepSeek published DSpark, a paper describing a speculative decoding system designed to accelerate LLM inference. The paper is hosted on DeepSeek's GitHub and attracted significant Hacker News engagement (598 points, 228 comments), suggesting meaningful community interest. Speculative decoding is an active inference optimization technique, and a release from DeepSeek carries weight given their track record on inference efficiency.
DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation for LLM Inference
DSpark is a new speculative decoding framework that combines a semi-autoregressive draft architecture with confidence-scheduled verification to improve LLM inference throughput. The semi-autoregressive design introduces intra-block token dependencies to reduce acceptance decay common in parallel drafters, while dynamic verification length tuning reduces wasted batch capacity in high-concurrency settings. Deployed within the DeepSeek-V4 serving system under live traffic, DSpark achieves 60–85% faster per-user generation speeds compared to the MTP-1 production baseline at matched throughput, and expands the Pareto frontier of latency-throughput tradeoffs.
DeepSeek releases DeepSeek-V4-Flash-DSpark on Hugging Face
DeepSeek has published a new model checkpoint, DeepSeek-V4-Flash-DSpark, on Hugging Face under the deepseek_v4 model family. The release is tagged as a text-generation model with FP8 and 8-bit support, suggesting an efficiency-optimized variant. The 'Flash' and 'DSpark' naming implies a faster or distilled derivative of the DeepSeek V4 flagship. Download counts are near zero, indicating a very recent upload.
DeepSeek releases DeepSeek-V4-Pro-DSpark on Hugging Face
DeepSeek has published a new model checkpoint, DeepSeek-V4-Pro-DSpark, on Hugging Face under the text-generation category. The model uses the deepseek_v4 architecture and supports FP8 and 8-bit quantization formats. The 'DSpark' suffix suggests a variant or specialized version of the DeepSeek V4 Pro line, though no accompanying technical documentation is visible in this listing.
DeepSeek V4 Preview Release: 1.6T-param Pro and 284B Flash Models with 1M Context, Open-Sourced
DeepSeek has released DeepSeek-V4 as an open-weights preview, comprising two MoE variants: V4-Pro (1.6T total / 49B active parameters) and V4-Flash (284B total / 13B active parameters). Both models support 1M token context by default, enabled by a novel Token-wise compression and DeepSeek Sparse Attention (DSA) architecture. V4-Pro claims open-source SOTA on agentic coding benchmarks and world-class math/STEM/coding performance rivaling top closed-source models, while V4-Flash offers near-parity reasoning at lower cost and latency. The API is live today with OpenAI and Anthropic compatibility, and legacy model endpoints will be retired in July 2026.
DeLS-Spec: Decoupled long-short context speculative decoding improves drafting efficiency
DeLS-Spec is a new speculative decoding method that combines a fixed block-parallel draft model (DFlash) as a long-context expert with a lightweight locally-trained short-context head, avoiding joint training with the target model. The approach introduces intra-block causal conditioning at low training cost and is modular across DFlash checkpoints. Experiments on Qwen3 models show consistent speedup and acceptance-length improvements over DFlash on math, code, and dialogue benchmarks.
DeepSeek releases EAGLE3 speculative decoding draft model for Qwen3-8B
DeepSeek published eagle3_qwen3_8b_ttt7 on Hugging Face, a draft model for EAGLE3 speculative decoding targeting the Qwen3-8B base model. EAGLE3 is DeepSeek's third-generation speculative decoding framework designed to accelerate inference by predicting future tokens with a lightweight draft head. The release is a narrow inference optimization artifact with minimal engagement at time of indexing.
DeepSeek releases EAGLE3 speculative decoding draft model for Qwen3-4B
DeepSeek published eagle3_qwen3_4b_ttt7 on Hugging Face, a draft model for EAGLE3 speculative decoding targeting the Qwen3-4B base model. EAGLE3 is DeepSeek's third-generation speculative decoding framework designed to accelerate inference by predicting future tokens with a lightweight draft model. The release is a narrow inference-optimization artifact with zero downloads and likes at time of indexing, suggesting it is very fresh or experimental.