AI & Models
Prompt caching
Reusing previously processed prefixes to cut cost.
When the same content is sent again, the provider reuses the earlier computation. Long system prompts and repeated documents get much cheaper and faster.
ExampleReading the same document repeatedly makes later calls far cheaper.
AI Knowledge Hub