I found Ruby LLM to be surprisingly good - in terms of usability it's close to Vercel's AI framework.

It tries to strike a balance between working out of the box and being flexible... which has its challenges, still nice overall.

One big real-life pain I experienced is that caches don't always work, e.g. for xAI, since it only supports completions API and thought signatures are returned wrong.

▲

earcar 4 hours ago | parent | next [-]

Thank you!

Responses API is now implemented and it's coming in RubyLLM 2.0

https://github.com/crmne/ruby_llm/blob/main/lib/ruby_llm/pro...

▲

techscruggs 4 hours ago | parent [-]

Do you have any details published around 2.0? Would love to learn more.

	▲	earcar 4 hours ago \| parent [-]
		Not yet. I'll do a series of blog posts and tweets in the next weeks.

▲

curtisboortz 35 minutes ago | parent | prev [-]

[flagged]