3 Commits

Author	SHA1	Message	Date
Luis Pater	95d5b2485f	fix(runtime): skip deferred tools when injecting cache_control ... - Updated `ensureCacheControl` to inject cache_control into the last non-deferred tool instead of the last tool. - Adjusted `injectToolsCacheControl` to ignore tools marked with `defer_loading` for prompt caching. - Added unit tests to validate behavior for deferred tools, existing cache_control, and mixed tool arrays. Closes: #4561	2026-07-25 23:20:17 +08:00
Luis Pater	7ff3936efe	fix(caching): ensure prompt-caching beta is always appended and add multi-turn cache control tests	2026-01-31 01:42:58 +08:00
Martin Schneeweiss	3a43ecb19b	feat(caching): implement Claude prompt caching with multi-turn support ... - Add ensureCacheControl() to auto-inject cache breakpoints - Cache tools (last tool), system (last element), and messages (2nd-to-last user turn) - Add prompt-caching-2024-07-31 beta header - Return original payload on sjson error to prevent corruption - Include verification test for caching logic Enables up to 90% cost reduction on cached tokens. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-01-29 22:59:33 +01:00