| ▲ | Laguna S 2.1(poolside.ai) | ||||||||||||||||||||||||||||||||||||||||||||||
| 159 points by rexledesma 5 hours ago | 33 comments | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | Lwerewolf 2 hours ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Testing it now. At the very least, competitive with DS4-Flash indeed. On my small (and per Sol's words, _very_ semantically dense) C test codebase, it found things that only gpt-5.2 managed to find back in the day, but also made a stupidly incorrect initial observation that a memfd_create()/mmap was used for IPC (funnily enough - sol missed that as well in its review, until I pointed it out). Re: the claims vs deepseek v4 - both flash and pro are expected to get a "general availability" release very soon (i.e. well-"post-trained"), so things can change in a... well, flash, as per usual in the current environment. Anyways, keep 'em coming. | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | mft_ 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Looks impressive, and this size fits achievable home hardware. That said, if someone would kindly quantise this down for the 64GB paupers, that would be appreciated. (I know there’s likely degradation, but some people reported good results with a 2 bit version of Qwen 3.5 122B, and this is starting from a higher point. Would be interesting to try, at least.) Edit: someone in the process of doing so: https://huggingface.co/vcruz305/Laguna-S-2.1-GGUF | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | river_otter 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Hey, this model is not a joke! Exciting, we already got a usable PR of work out of it. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | kamranjon 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Whoa whoa whoa, 118b params, 8b active MOE, long context reasoning, open weights - music to my ears. Hadn't heard of this lab before but I am very excited, will definitely try this out tomorrow - this is a real sweet spot I think in terms of model size and performance. | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | mchusma 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Incredible. This is definitely the launch of the day. Just crushing Google's releases. The pricing here is incredible. This is the first US release that's competitive with DeepSeek V4 Flash. Very excited about this. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | benjiro29 25 minutes ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
!! Be careful when testing the model. A lot of people are testing it, and reporting disappointed results / benchmaxxxing claim. But do not realize that thinking has a issue with the default configuration. Important - make sure that THINKING is enabled. By default it wasn't although I was passing the flag --default-chat-template-kwargs '{"enable_thinking": true}' in vllm recipe. The generation_config.json file that is included has by default max_new_tokens as 32k which seems to be cutting off thinking altogether so increase it. At first I was very disappointed with the output I was seeing, but once thinking is enabled, the code quality seems to be MUCH better. More real world testing to be done. https://www.reddit.com/r/LocalLLaMA/comments/1v2pg99/laguna_... | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | Iolaum 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Model Looks amazing! Even more important, subjectively, is that this model will run very well on Strix Halo (e.g. Framework Desktop), DGX Spark kinds of devices. Looking forward to Unsloth dynamic mtp quants. P.S. Looking at the HF release they already offer Q4_K_M and DFlash drafter for speculative decoding! | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | loolhahalmao 11 minutes ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
happy the US has some counterweights to the Chinese labs, just need about half a dozen more. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | SwellJoe 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
This is exactly the kind of model that's been needed in the middle. Realistically self-hosted, Good Enough intelligence, MoE so it's fast on limited bandwidth systems like Strix Halo and DGX Spark. For a while there's been nothing to run on my Strix Halo that's notably better than what I can run on my dual 32GB GPU desktop (Gemma 4 or Qwen 3.6 dense models), but this seems likely to be the step up in size that actually works better than those. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | docheinestages 38 minutes ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Any estimates of the performance (prompt processing and decoding tokens/s) on consumer hardware like Macbook Pro M-series? | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | river_otter 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I love this. Is it possible to give a feel of how this stacks up to the good old Opus 4.5 in coding quality? For me that was the turning point where agentic coding in Claude Code etc became usable. Have we hit that threshold? | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | megavon 3 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
This is INSANE. How did they do this? | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | tosh 3 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
open weights and similar performance to deepseek v4, inkling at size of nemotron 3 super (!) | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | iraldir 3 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Amazing model at this size if true, that's quite crazy! | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | carimura an hour ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Congrats Poolside team!! | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | danr4 24 minutes ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||||||||
holy shit its accelerating fast | |||||||||||||||||||||||||||||||||||||||||||||||