Almanac
technique

Message Passing Language Models

techniqueactiveprovisionalmessage-passing-language-models-2c0a3f2f·1 events·first seen 32h ago

Aliases: Message Passing Language Models

Co-occurring entities

More like this (12)

Recent events (1)

6arXiv · cs.CL·32h ago·source ↗

Message Passing Language Models (MPLMs) enable efficient parallel reasoning via inter-thread communication

Researchers introduce Message Passing Language Models (MPLMs), a framework that extends parallel inference-time scaling by allowing LLM reasoning threads to communicate directly via send/receive primitives rather than operating in isolation as in fork-join approaches. MPLMs reduce computational costs through avoiding redundant context sharing and enabling early termination of unpromising branches (preemption). The framework is demonstrated on Sudoku puzzles (achieving asymptotically smaller context than CoT or fork-join), 3-SAT problems, and long-context QA, with a fine-tuned model solving 25×25 Sudoku puzzles that challenge frontier reasoning models.