Remix.run Logo
JPLeRouzic 7 hours ago

Could it be use of a tainted Claude?

For example a user query is transformed to filter the request to and the answer from Claude with a local open source model.

Use case: A user asks to find a bug in code, they provide a large piece of code (hence a large amount of tokens), it is processed by the retailer with an open source LLM which is asked to extract suspicious snippets, and Claude is asked to provide an exact answer but as short as possible, then the local open source model is asked to incorporate the modifications in the original code.

The number of tokens used by Claude is much lower than if the user has asked directly to Claude. The local open source model provides the difference.