| ▲ | palata 3 hours ago |
| "If", sure. How many developers here don't see a difference between the latest LLMs and SLMs they can run on their own computer? I tried running a smaller model locally, and it's not usable for me. I know people like to "predict" things, so that if they happen they can then say "I am a visionary, I predicted it" and start their blog posts with "as I predicted long ago (because I am a visionary), ...". > The research report estimates that the addressable market in the US for SLMs has grown to about $10tn or one-third of the entire US GDP of $30tn. There isn’t much left for LLMs to thrive in, and every year, their advantage over SLMs is shrinking. I stopped counting the number of times "estimates" said that a market would absolutely explode, and it absolutely didn't. Those are in the business of being a broken clock. If something better comes, it will be better. Sure. And we would like to have something better, because it would be better. |
|
| ▲ | ch_sm 2 hours ago | parent | next [-] |
| > I tried running a smaller model locally, and it's not usable for me. If you have the hardware, a MacBook Pro for Qwen 3.6 35B A3B and Gemma 4 26B A4B for example, they are absolutely usable, both in terms of speed and quality. Anecdotally, I can use Qwen for day-to-day coding tasks in TS and Go, without hickups. |
| |
| ▲ | gessha 2 hours ago | parent | next [-] | | I’ve been experimenting with Qwen 3.8 27B and I believe I can totally use it as my main coding model provided I have the hardware for the full context. I don’t need my model to be opus level. I need it to do the tasks I want it to do without being an overprotective nanny. | |
| ▲ | embedding-shape 2 hours ago | parent | prev | next [-] | | I'm unable to find a local model that comes close to the effectiveness of GPT models in Codex, and I have 96GB of VRAM available and tried every local model under the sun so far. Neither of those you mention I'd say are good enough for day to day software engineering for me, but I'm also really strict about code quality and iterate on what outputs agents give me a lot before I'm happy. With local models, this iteration cycle takes maybe 30 minutes for a single fix or feature, rather than 10 minutes with GPT+Codex, as there is so many corrections and iterations needed, although I will say that the speed I'm able to get locally makes it more fun that any of the remote models. | | |
| ▲ | rapind an hour ago | parent [-] | | > although I will say that the speed I'm able to get locally makes it more fun that any of the remote models. This is becoming increasingly important to me. Super smart max reasoning frontier is fine if I leave it running overnight on some prepared set of clearly defined tasks, but when I want to work with the LLM, throughput really matters, and I'll go with a dumber model to get there. At some point though, it's fast enough and any speed gains beyond that just makes me the bottleneck. I also am seeing the smaller models gaining big strides lately, closing the gap on frontier models (still a decent sized gap though). I don't even run the small models like Qwen 3.8 27B locally. I just try them out in the cloud to see how they are progressing, and I'm definitely able to be productive. |
| |
| ▲ | jatora an hour ago | parent | prev | next [-] | | No, you cant. I challenge anyone who claims this to show me an actual project built only by SLM's and not using opus, sonnet, sol, or terra. Spoiler: you can't. | |
| ▲ | everyone 2 hours ago | parent | prev [-] | | You let a hiccup slip through in your comment though. |
|
|
| ▲ | 2 hours ago | parent | prev | next [-] |
| [deleted] |
|
| ▲ | root-parent 3 hours ago | parent | prev | next [-] |
| >> I stopped counting the number of times "estimates" said that a market would absolutely explode, and it absolutely didn't. Those are in the business of being a broken clock. The lack of logic and risk management on this statement, is so strong, I hope humans are all quickly substituted by LLMs. Lets just do it and be done with it... |
| |
|
| ▲ | otabdeveloper4 2 hours ago | parent | prev [-] |
| > I tried running a smaller model locally, and it's not usable for me. Probably a skill issue on your part. |
