technique

Random Language Model

techniqueactiveprovisionalrandom-language-model-c42718b2·1 events·first seen 18h ago

Aliases: Random Language Model

Co-occurring entities

Random Energy Model Scaling limit of the Random Language Model

More like this (12)

Scaling limit of the Random Language Model Diffusion Language Models AnyLanguageModel Transformer Language Models Reasoning Language Models Recursive Language Models (RLMs)mRNA Language Model Reinforcement Learning for Language Models Tapered Language Models Latent Context Language Models multi-turn language models unsupervised language modeling

Recent events (1)

4arXiv · cs.CL·18h ago·source ↗

Scaling limit theory of the Random Language Model reveals condensation transition and language statistics

A new arXiv preprint develops a quantitative theory of the Random Language Model (RLM), an ensemble of stochastic context-free grammars, in a scaling limit where grammar size and temperature are jointly tuned. The authors identify a condensation phase transition at a critical parameter value and derive explicit scaling laws for entropy, rule diversity, and related observables across distinct regimes. The work claims to resolve prior ambiguities about thermodynamic transitions in language models and offers a unified framework connecting generative grammar statistics to universal properties of natural language and LLM behavior.

Evaluation and Benchmarking Random Energy Model Random Language Model Scaling limit of the Random Language Model