Remix.run Logo
victorbjorklund 3 hours ago

What does do a mistral mean?

goldenarm 3 hours ago | parent [-]

MistralAI is known for their smaller models on the edge, to avoid competing with Gemini & OpenAI directly.

mycall 3 hours ago | parent [-]

Who knows if OpenAI will do a refresh, but gpt-oss-20B/120B are still some of the best edge models so far.

carterschonwald 2 hours ago | parent [-]

oh?! what do they handle well? how do they fail?

the 3.5 9b model on my laptop at full fp8 is outlandish in its seeming reasoning capacity, though i haven’t really stress tested it