01
Prompt caching wired by default
System prompts and long context cached on every call. Cache hit rate measured on your real traffic rather than assumed. Repeat context is not paid for twice, which is where most of an unoptimised token bill goes.
Cost per AI call drops from cents to fractions of a cent.