product

block-sparse GPU kernels

productactiveblock-sparse-gpu-kernels-2fc5a9eb·1 events·first seen 28d ago

Aliases: block-sparse GPU kernels

Co-occurring entities

cuBLAS cuSPARSE block-sparse weights OpenAI

More like this (12)

block-sparse weights block sparse matrices GPU cluster Block Sparse Attention cuSPARSE ZeroGPU sparse gating WebGPU Sparse Circuits GPU GPU power capping CUDA

Recent events (1)

4Openai Blog·28d ago·source ↗

OpenAI Releases Block-Sparse GPU Kernels for Sparse Neural Networks

OpenAI released optimized GPU kernels targeting block-sparse neural network architectures, claiming orders-of-magnitude speedups over cuBLAS and cuSPARSE depending on sparsity level. The kernels were applied to achieve state-of-the-art results in text sentiment analysis and generative modeling of text and images. This release represents an early infrastructure contribution toward efficient sparse computation in deep learning.

Training Infrastructure Inference Economics cuBLAS cuSPARSE block-sparse GPU kernels +2 more