Importance 2 of 5Covered by 1 source
Amazon Bedrock supports prompt caching for open-weight models
Open-weight models on Amazon Bedrock can now reuse cached prompt prefixes across requests. Bedrock manages the cache, with implicit caching available depending on the model.
Why it matters
Applications sending long repeated context can lower input costs and latency.