WebGPT: Improving the factual accuracy of language models through web browsing
OpenAI fine-tuned GPT-3 to answer open-ended questions more accurately by giving it access to a text-based web browser. The system, called WebGPT, uses reinforcement learning from human feedback to learn to search the web, read pages, and cite sources. This work represents an early demonstration of retrieval-augmented generation and tool-use in large language models.
Related guides (4)
Related events (8)
SearchGPT: OpenAI Prototype for AI-Powered Search
OpenAI announced SearchGPT, a temporary prototype integrating real-time web search capabilities into a conversational AI interface. The prototype aims to deliver fast, timely answers with clearly attributed sources. It represents OpenAI's direct entry into AI-native search, competing with existing players like Perplexity and Microsoft Bing AI.
Better language models and their implications
OpenAI announced GPT-2, a large-scale unsupervised language model capable of generating coherent multi-paragraph text and achieving state-of-the-art performance on language modeling benchmarks. The model demonstrated zero-shot capability across reading comprehension, machine translation, question answering, and summarization without task-specific fine-tuning. OpenAI notably withheld the full model release citing misuse concerns, marking an early high-profile instance of staged/responsible release policy.
Introducing ChatGPT Search
OpenAI has launched ChatGPT Search, a feature that provides fast, timely answers with links to relevant web sources directly within ChatGPT. This integrates real-time web retrieval into the ChatGPT interface, moving the product closer to a search engine replacement. The announcement comes from OpenAI's official blog, indicating a significant product expansion.
Improving Language Understanding with Unsupervised Learning (GPT-1)
OpenAI published the GPT-1 paper in June 2018, demonstrating state-of-the-art results across diverse language tasks by combining transformer architectures with unsupervised pre-training followed by supervised fine-tuning. The approach is task-agnostic and scalable, showing that pre-training on large unlabeled text corpora and then fine-tuning on specific tasks yields strong generalization. This work established the foundational paradigm that would evolve into GPT-2, GPT-3, and subsequent large language models.
New GPT-3 capabilities: Edit & insert
OpenAI released updated versions of GPT-3 and Codex that support editing and inserting content into existing text, expanding beyond the original completion-only paradigm. These new capabilities allow the models to make targeted modifications to text rather than only appending to it. The release represents an incremental but meaningful expansion of the GPT-3 API surface.
Customizing GPT-3 for your application
OpenAI announced fine-tuning capabilities for GPT-3, enabling developers to customize the model for specific applications via a single command. This feature allows users to adapt GPT-3's behavior to their use case by training on domain-specific data. The announcement marks an early milestone in making large language model customization accessible through an API.
GPT-4 Release
OpenAI released GPT-4, a large multimodal model accepting image and text inputs and producing text outputs. The model demonstrates human-level performance on various professional and academic benchmarks. It represents OpenAI's latest milestone in scaling deep learning.
GPT-3 Powers Over 300 Applications via OpenAI API
OpenAI reports that more than 300 applications are now using GPT-3 through its API to deliver search, conversation, text completion, and other AI features. The announcement highlights the growing commercial ecosystem built on top of GPT-3 as of early 2021. This represents an early milestone in API-based AI deployment at scale.