Almanac
← Events
5Interconnects (Nathan Lambert)·1mo ago

Reading today's open-closed performance gap

This commentary from Interconnects analyzes the factors that determine benchmark evaluation scores and the performance gap between open-weight and closed frontier models. It examines how various complex variables contribute to the single evaluation numbers that dominate public discourse, and considers how this gap may evolve over time. The piece is framed as an analytical take on the current state of open vs. closed model competition.

Related guides (3)

Related events (8)

5Interconnects·1mo ago·source ↗

Open Models in Perpetual Catch-Up

A commentary piece from Interconnects examining the structural dynamics between open-weight and closed frontier models, covering topics including the open-closed capability gap, distillation as a catch-up mechanism, innovation timescales, and conditions under which open models can win. The piece also addresses specialized models and gaps in the current open ecosystem. This is a high-level analytical framing of a persistent tension in the AI landscape rather than a report on a specific release or event.

5Interconnects·19d ago·source ↗

Open and closed models are on different exponentials

This commentary from Interconnects argues that open-weight and closed-weight AI models are following distinct capability and value trajectories. The piece examines where marginal intelligence gains drive meaningful value versus where they do not, suggesting the two model classes are not in direct competition on the same curve. This framing has implications for how labs, enterprises, and researchers should think about model selection and deployment strategy.

5Interconnects·1mo ago·source ↗

My bets on open models, mid-2026

A Interconnects commentary piece forecasting the trajectory of open-weight models through mid-2026, with a focus on the gap between open and closed frontier models. The author offers predictions about which open-weight developments are most likely to close the capability gap with proprietary systems. As a tier-2 source, this represents informed industry analysis rather than primary reporting.

5Interconnects·1mo ago·source ↗

What comes next with open models

A Interconnects commentary piece examining the next phase of open model development, covering market dynamics, capability trajectories, and the broader industrialization of language models. The piece appears to survey the competitive and technical landscape for open-weight models as they mature. Published in March 2026, it reflects on the state of the open-model ecosystem amid rapid frontier progress.

5Interconnects·1mo ago·source ↗

Gemma 4 and what makes an open model succeed

A commentary piece from Interconnects analyzing Google's Gemma 4 release and the broader question of what drives success for open-weight models. The piece argues that benchmark scores are not the primary determinant of open model adoption or impact. This is a tier-2 analytical take on the open-weights ecosystem and the strategic dynamics around model releases.

5Interconnects·1mo ago·source ↗

Opus 4.6, Codex 5.3, and the post-benchmark era

A Interconnects commentary piece examining how to compare frontier AI models in 2026, using Anthropic's Opus 4.6 and OpenAI's Codex 5.3 as case studies. The piece appears to argue that traditional benchmarks are no longer sufficient for distinguishing model capabilities at the frontier. This reflects a broader industry shift toward more nuanced, task-specific evaluation methods.

5Interconnects·1mo ago·source ↗

How Open Model Ecosystems Compound

This Interconnects commentary examines how China's open-first, high-participation AI ecosystem creates compounding advantages over time. The piece reflects on the structural dynamics of open model ecosystems and their strategic implications. It appears to analyze how broad community participation in open-weight model development accelerates capability progress.

6Hugging Face Blog·1mo ago·source ↗

What's going on with the Open LLM Leaderboard?

Hugging Face published a commentary examining anomalies and issues observed in the Open LLM Leaderboard, focusing on MMLU benchmark results. The post investigates potential data contamination, evaluation inconsistencies, and scoring discrepancies across open-weight models. It raises concerns about the reliability of MMLU as a benchmark signal and the integrity of leaderboard rankings.