Radar
Top stories
Importance 2 of 5Covered by 1 source

Amazon Bedrock supports prompt caching for open-weight models

Open-weight models on Amazon Bedrock can now reuse cached prompt prefixes across requests. Bedrock manages the cache, with implicit caching available depending on the model.

Why it matters

Applications sending long repeated context can lower input costs and latency.