Cover

Photo: StockSnap (CC0)
What you are probably seeing
Your invoice shows the same total token volume as last month despite the lower per-token rate. The usage dashboard reveals that large chunks of static content like system prompts or logs are being sent with every request.
You notice that the workflow spends most of its time and budget on reading files that have not changed since the last run. The actual creative or analytical work is a tiny fraction of the total input size.
Why it happens
Most agents and scripts load context from scratch for each new task to ensure accuracy and safety. This defensive approach treats every interaction as new, forcing the system to re-transmit identical data that the API has already seen.
Without caching, the API provider must process and bill for every single token sent in the input. This means you pay the full input cost for repeated headers, documentation, or logs every time they are referenced in the prompt.
What changed recently
Step by step
1. Audit your prompts to identify static blocks of text that remain identical across multiple requests. Design your code to separate these static parts from dynamic user inputs. Implement caching keys or specific headers in your API calls to store that static data. Test the workflow to confirm that the provider is recognizing and reusing the cached content. Monitor your next bill to verify that the input cost has dropped for those repeated sections.
Ways to go further
Affiliate links: CHEAPUNO may earn a commission if you buy through them, at no extra cost to you.
Other problems readers raise
Why does Docker Agent break on large outputs over 10k characters?
Can I run Codex review prompts on Gemini or Claude?
How to replace SaaS with local AI agents on low-cost hardware?
How to run multi-agent coding teams with free models and git worktrees
Does Copilot per-token pricing fit your small business budget?
