technique
Random Energy Model
techniqueactiveprovisional
random-energy-model-d9dcedc5·1 events·first seen 19h agoAliases: Random Energy Model
Co-occurring entities
More like this (12)
Energy-Based ModelsRandom Language ModelJoint Energy-Based Models (JEMs)Shuffle ModelAutoregressive Boltzmann Generatorsdynamics randomizationSurvival Diffusion Probabilistic Model (SDPM)ESM (Evolutionary Scale Modeling)discrete diffusion modelsmean-field theorySemantic EntropyOrnstein-Uhlenbeck stochastic differential equation
Recent events (1)
Scaling limit theory of the Random Language Model reveals condensation transition and language statistics
A new arXiv preprint develops a quantitative theory of the Random Language Model (RLM), an ensemble of stochastic context-free grammars, in a scaling limit where grammar size and temperature are jointly tuned. The authors identify a condensation phase transition at a critical parameter value and derive explicit scaling laws for entropy, rule diversity, and related observables across distinct regimes. The work claims to resolve prior ambiguities about thermodynamic transitions in language models and offers a unified framework connecting generative grammar statistics to universal properties of natural language and LLM behavior.