0
Mike Bifulco · 2mo · discuss
Prompt caching is a prefix match: one changing byte near the top of your prompt drops your hit rate to zero. A timestamp is the obvious culprit - here are the rest.
Mike Bifulco · 2mo · discuss
Prompt caching is a prefix match: one changing byte near the top of your prompt drops your hit rate to zero. A timestamp is the obvious culprit - here are the rest.
We can't find the internet
Attempting to reconnect
Something went wrong!
Attempting to reconnect