Simon Willison ports Moebius 0.2B image inpainting model to run in-browser using Claude Code
Simon Willison documents porting the Moebius 0.2B image inpainting model to run entirely in the browser, using Claude Code as an AI-assisted development tool. The project demonstrates both client-side ML inference and agentic coding workflows. It is a practical case study at the intersection of browser-based model deployment and AI-assisted software development.
Related guides (4)
Related events (8)
Generate Images with Claude and Hugging Face via MCP
Hugging Face published a blog post demonstrating how to use Claude with the Model Context Protocol (MCP) to generate images through Hugging Face's inference infrastructure. The integration allows Claude to call Hugging Face image generation models as tools via MCP, connecting frontier LLMs with open-weight diffusion models. This represents a practical example of the agent-tool ecosystem pattern where LLMs orchestrate specialized model endpoints.
Making ML-powered web games with Transformers.js
This Hugging Face blog post demonstrates how to build machine learning-powered web games using Transformers.js, enabling in-browser inference without a server backend. The post covers practical implementation patterns for running transformer models directly in the browser via WebAssembly and WebGL. It serves as both a tutorial and a showcase of client-side ML deployment capabilities.
Anthropic Releases Computer Use Capability for Claude 3.5 Sonnet
Anthropic has launched a public beta of computer use for Claude 3.5 Sonnet, enabling the model to control a computer by interpreting screenshots and issuing pixel-level cursor and keyboard commands. The model achieves 14.9% on the OSWorld benchmark, roughly double the next-best AI model's 7.7%, though well below human-level performance of 70-75%. Anthropic trained the model on a small set of simple software tools and found it generalized rapidly to broader computer interaction. Safety analysis confirmed the capability remains at AI Safety Level 2, with prompt injection identified as a primary near-term risk.
Using Claude Code: The Unreasonable Effectiveness of HTML
Simon Willison shares commentary on using Claude Code, Anthropic's agentic coding tool, with a focus on HTML as an output format. The piece appears to explore practical workflows and observations from hands-on use of Claude Code. As a tier-2 practitioner commentary, it likely covers patterns, tips, or surprising findings about how Claude Code handles HTML generation or web-oriented tasks.
We Got Claude to Fine-Tune an Open Source LLM
Hugging Face demonstrates using Claude (Anthropic's model) as an orchestrating agent to autonomously fine-tune an open-source LLM, showcasing an agentic workflow for model training. The post illustrates how a frontier model can handle the end-to-end process of dataset preparation, training configuration, and execution for a smaller open-weights model. This represents a practical example of AI-assisted ML engineering and agent-tool ecosystem development.
Anthropic introduces computer use capability, upgraded Claude 3.5 Sonnet, and Claude 3.5 Haiku
Anthropic announced three major developments: an upgraded Claude 3.5 Sonnet with significant coding improvements (SWE-bench Verified rising from 33.4% to 49.0%, surpassing all publicly available models including reasoning models), a new Claude 3.5 Haiku that matches Claude 3 Opus performance at Haiku-tier speed, and a public beta of 'computer use' — a capability allowing Claude to control computers by viewing screens, moving cursors, clicking, and typing. Computer use is available via the Anthropic API, Amazon Bedrock, and Google Cloud Vertex AI, with early adopters including Replit, The Browser Company, and Cognition. Both safety institutes (US AISI and UK AISI) conducted pre-deployment testing, and the model was assessed as remaining within ASL-2 under Anthropic's Responsible Scaling Policy.
Claude 3.7 Sonnet and Claude Code: Anthropic's First Hybrid Reasoning Model and Agentic Coding Tool
Anthropic has released Claude 3.7 Sonnet, described as their most capable model to date and the first hybrid reasoning model on the market, capable of operating in both standard and extended thinking modes within a single unified model. The model achieves state-of-the-art results on SWE-bench Verified and TAU-bench, with particular strength in coding and front-end web development. Alongside the model, Anthropic is launching Claude Code in limited research preview, a command-line agentic coding tool that can read/edit files, run tests, and push to GitHub. Pricing remains unchanged at $3/M input and $15/M output tokens, with availability across Claude.ai plans, Amazon Bedrock, and Google Cloud Vertex AI.
smol-ai/GodMode: multi-model AI chat browser aggregating ChatGPT, Claude, Bard, and others
GodMode is an open-source TypeScript desktop app that provides unified browser-based access to multiple AI chat interfaces including ChatGPT, Claude, Bard, Bing, and Llama 2. The project has accumulated 5,536 GitHub stars with modest recent momentum (+14 today). It functions as a thin wrapper enabling side-by-side or rapid switching between frontier chat products.