Anthropic Launches Prompt Caching for Claude Models
Anthropic has introduced prompt caching on its API, allowing developers to avoid repeating prompts by remembering context between API calls. The feature is available in public beta on Claude 3.5 Sonnet and Claude 3 Haiku, with support for the largest model, Opus, coming soon. Prompt caching lets users keep frequently used contexts in their sessions, … Read more