4arXiv cs.AI (Artificial Intelligence)·
Differentiable Logic Gate Networks achieve low-latency EEG classification on edge devices
Researchers evaluate Differentiable Logic Gate Networks (Diff-Logic) for real-time EEG classification on edge hardware, compiling models into pure Boolean circuits executable via bitwise CPU operations. Across four EEG datasets covering dementia detection and emotion recognition, Diff-Logic matches or outperforms MLP and Binarized Neural Network baselines while achieving up to 2.9× speedup and 14× smaller model size on a 7W Nvidia Jetson Orin Nano. Inference latency remains nearly constant as model scale increases 10×, making the approach attractive for resource-constrained brain-computer interfaces.
Related guides (2)
Related events (8)
Gated DeltaNet-2: Decoupling Erase and Write Gates in Linear Attention
Gated DeltaNet-2 is a new linear attention architecture from NVIDIA Labs that separates the erase and write operations in the delta-rule update into independent channel-wise gates, generalizing both Gated DeltaNet and Kimi Delta Attention (KDA). The model introduces a chunkwise WY algorithm with channel-wise decay and a gate-aware backward pass for efficient parallel training. At 1.3B parameters trained on 100B FineWeb-Edu tokens, it outperforms Mamba-2, Gated DeltaNet, KDA, and Mamba-3 variants on language modeling, commonsense reasoning, and long-context RULER needle-in-a-haystack retrieval benchmarks. Code is publicly released via NVlabs on GitHub.
Optimizing Stable Diffusion for Intel CPUs with NNCF and Hugging Face Optimum
This Hugging Face blog post details techniques for optimizing Stable Diffusion inference on Intel CPUs using Neural Network Compression Framework (NNCF) and the Optimum library. The workflow covers quantization and other compression methods to reduce latency and memory footprint on CPU hardware. This is relevant to the inference-economics and enterprise-deployment threads as it addresses running diffusion models without dedicated GPU hardware.
Accelerating Stable Diffusion Inference on Intel CPUs
This Hugging Face blog post details techniques for optimizing Stable Diffusion inference on Intel CPUs, likely covering quantization, operator fusion, and Intel-specific hardware acceleration libraries. The post addresses the practical challenge of running diffusion models on CPU hardware without dedicated GPUs. This is relevant to inference economics and enterprise deployment patterns where GPU availability is constrained.
NeuronSoup: Asynchronous shared-neuron temporal graph architecture evolved without backpropagation
NeuronSoup is a neural computation architecture that replaces synchronous layer-by-layer processing with asynchronous, delay-mediated signal propagation through a pool of physically shared neurons, optimized entirely by a genetic algorithm rather than gradient descent. On MNIST digit classification using frozen ResNet18 features, the evolved network achieves 85.9% test accuracy with 204 active paths through 266 hidden neurons, fitting in 115 KB. The architecture requires no differentiable computation graph, adapts computation depth per sample, and discovers lateral pathway interactions without explicit engineering. The authors argue genetic algorithms are the appropriate optimizer for this problem class and discuss why CMA-ES fails at this scale.
BIRDNet: Interpretable Neural Networks via Boolean Implication Knowledge Graphs for Tabular Data
BIRDNet is a neurosymbolic architecture that mines Boolean implication relationships (BIRs) from tabular data using a sparse-exception binomial test, then encodes the resulting directed graph as the connectivity structure of a layered neural network. Each hidden unit corresponds to exactly one mined rule and binds only to its two features, yielding up to 96× parameter reduction versus a matched dense MLP. Evaluated on six transcriptomic and proteomic benchmarks, BIRDNet stays within 0.02 AUROC of dense baselines while recovering known biological signatures such as canonical amplicons and immune-infiltration markers. Unlike most neurosymbolic approaches, BIRDNet derives its structural prior from data rather than an external rule base.
Faster Stable Diffusion with Core ML on iPhone, iPad, and Mac
Hugging Face published a blog post detailing optimizations for running Stable Diffusion models via Core ML on Apple devices including iPhone, iPad, and Mac. The post covers techniques to accelerate on-device inference using Apple's neural engine and Core ML framework. This represents progress in deploying capable diffusion models at the edge without cloud dependency.
Case Study: Millisecond Latency using Hugging Face Infinity and modern CPUs
Hugging Face published a case study examining the inference performance of their Infinity product on modern CPUs, targeting millisecond-level latency for NLP model serving. The post explores CPU-based deployment as a cost-effective alternative to GPU inference for transformer models. This is relevant to the inference economics and enterprise deployment patterns threads, though the content is from early 2022.
Fine-tuning Stable Diffusion models on Intel CPUs
This Hugging Face blog post describes a workflow for fine-tuning Stable Diffusion image generation models on Intel CPUs rather than GPUs. It covers the tooling and optimizations required to make CPU-based diffusion model training practical, relevant to inference-economics and hardware diversification trends. The post targets practitioners looking to reduce dependency on GPU hardware for generative model fine-tuning.