Remix.run Logo
RussianCow a day ago

How else would you expect them to calculate it?

dakolli 17 hours ago | parent [-]

Do you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.

RussianCow 13 hours ago | parent [-]

They're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session?

FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.