Section
Prompt Caching
The latest Prompt Caching coverage from Bullquill: sourced, dated and explained.
1 POSTSUPDATED
IndexDate · Title · Reading time
No articles in this language here yet. Showing English.
-
How to reduce LLM API costs: caching, batching and model routing
Log input, cached, output and thinking tokens first, then apply four techniques in Python. Cache reads cost 0.1x the normal input price or less at OpenAI and Anthropic, and batch APIs charge 50% of standard prices.
