Remix.run Logo
▲ jakswa an hour ago

might need this if trying to test on llama.cpp https://github.com/ggml-org/llama.cpp/pull/32695 -- "Adds support for https://huggingface.co/thinkingmachines/Inkling-2-Mini - uses a looped architecture and this PR adds looped support"

▲hrncn 43 minutes ago | parent | next [-]

Let's hope these make it into master, and don't end up like the diffusiongemma patchsets. It is always a bit sad if the exotic and exciting models don't make it into master and all the people using prebuilt llama can't just give them a try. Tho I can understand why these in particular might not be wanted in master.

▲jakswa an hour ago | parent | prev [-]

and this lol: https://github.com/ggml-org/llama.cpp/pull/32694