technique

connection-scoped caching

techniqueactiveconnection-scoped-caching-ad77a6cb·1 events·first seen 28d ago

Aliases: connection-scoped caching

Co-occurring entities

More like this (12)

Context Caching on Disk Prompt Caching KV Cache LMCache Content Credentials in-context learning shared control Key-Value Cache CUDA Locality-Sensitive Hashing Attention TimeScope ModelScope

Recent events (1)

5Openai Blog·28d ago·source ↗

Speeding up agentic workflows with WebSockets in the Responses API

OpenAI published a technical deep dive into the Codex agent loop, detailing how WebSockets and connection-scoped caching were used to reduce API overhead and improve model latency. The post focuses on infrastructure optimizations within the Responses API for agentic workflows. These changes are relevant to developers building multi-step agent pipelines that rely on repeated API calls.

Inference Economics Agent and Tool Ecosystem connection-scoped caching Responses API OpenAI +2 more