Remix.run Logo
7thpower 3 days ago

This is a basic question but maybe you can help: what is a good resource to use to understand how to take advantage of logits?

ivape 3 days ago | parent [-]

https://dottxt-ai.github.io/outlines/latest/

For OpenAI, you can just pass in the json_schema to activate it, no library needed. For direct LLM interfacing you will need to host your own LLM or use a cloud provider that allows you too hook in, but someone else may need to correct me on this.

If anyone is using anything other than Outlines, please let us know.

7thpower 2 days ago | parent [-]

Thank you!