Entity · technique

connection-scoped caching

techniqueactiveconnection-scoped-caching-ad77a6cb·1 events·first seen May 19, 2026

Aliases: connection-scoped caching

Co-occurring entities

More like this (12)

Context Caching on Disk Prompt Caching KV Cache IndexCache LMCache Content Credentials in-context learning shared control Key-Value Cache CUDA Locality-Sensitive Hashing Attention TimeScope

Recent events (1)

5Openai Blog·May 19, 2026·source ↗

Speeding up agentic workflows with WebSockets in the Responses API

OpenAI published a technical deep dive into the Codex agent loop, detailing how WebSockets and connection-scoped caching were used to reduce API overhead and improve model latency. The post focuses on infrastructure optimizations within the Responses API for agentic workflows. These changes are relevant to developers building multi-step agent pipelines that rely on repeated API calls.

Inference Economics Agent and Tool Ecosystem connection-scoped caching Responses API OpenAI +2 more