▲ | causal 2 days ago | |||||||
Do you have a package for calling LLM services we can use? This service is neat, but I don't need another LLM IDE built in Elixir but I COULD really use a way to call LLMs from Elixir. | ||||||||
▲ | chrismccord 2 days ago | parent [-] | |||||||
Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :) | ||||||||
|