Remix.run Logo
Using an open model feels surprisingly good(matthewsaltz.com)
61 points by msaltz an hour ago | 28 comments
wps 20 minutes ago | parent | next [-]

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc

The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with it. If you’re using it as an aid to traditional software dev, iterating on small, targeted functions, GLM works as good if not better than Claude. Anthropic expects low quality prompts. If you rubber duck GLM, you get absolutely pristine output in most cases.

drnick1 a minute ago | parent | next [-]

Frontier models like Opus 5 are also extremely good a "research" in an academic sense, including combining elements from different fields or literatures and creating something quite novel sometimes, publishable even, from vague/speculative prompts. This is on top of implementing known methods in about 1/100th of the time it would take by hand, allowing for fast exploration of ideas. It's also great because you can instruct it to roll things out from scratch, removing essentially all dependencies on third party code other than Numpy or Scipy from your project.

Gigachad 16 minutes ago | parent | prev [-]

Personally I've found Deepseek v4 Flash to be as useful to me as Opus. But I don't do these silly one shot tech demos. I have the technical understanding to ask for exactly the change I want with the right terminology. I loaded up some credit on openrouter and it took me ages to hit $1 in spend.

wps 10 minutes ago | parent [-]

I’m the exact same way. $15 on openrouter lasted me so long it would’ve got me fired at FAANG. Despite this, my number of commits is dramatically higher. Small, beautifully scoped changes is just good software development, and good for the wallet as well.

I think the issue is that no one is content with incremental progress. We all know one shots are mostly possible, so the age of the personal project is kind of over. There’s no motive to invest dozens of hours getting a working prototype when Claude can give you something right now. So you can’t make small changes until you have that codebase in place already. You’re forced to make sweeping changes if you use AI from the beginning. And it’s not like it matters, there’s no personal attachment to any one part of the code, it’s not even seen!

Gigachad 4 minutes ago | parent [-]

I can see why Anthropic is freaking out right now. China has undermined their whole business. AI models will be basic commodities where hosting providers earn a tiny margin over the raw costs rather than the predicted fortunes from being the gatekeepers to the technology.

arjie 35 minutes ago | parent | prev | next [-]

To be honest, I am surprised by how good DeepSeek V4 Flash is. I use Claude Code and Codex on Claude 5 Opus and GPT-5.6 Sol most of the time, but when I use DS V4 Flash I don't feel like it's really that bad. And with oh-my-pi and just plain pi it's pretty good. To be honest the frontier models are much better at tool calling so in an assistant flow they're better but I did the dumb thing and optimized the harness for the model instead, rewriting the tools so they match what it guesses at, and DS V4 Flash does just fine.

The TTFT and tok/s are much higher on the small model so that makes it competitive for a bunch of things. It feels like what old Sonnet used to by the end of last year which is honestly damned good.

pimeys 22 minutes ago | parent [-]

I wrote my own OpenClaw one weekend and I am running it as my assistant through Matrix with DeepSeek v4 Flash (and Qwen). It probably costs me about 2 dollars a month and is even more useful than ChatGPT would be due to me having full control on what tools it has access to.

I can do things like take a photo of a doctor's note among add the appointment to my calendar, send a PDF to my archive tagged, OCR'd etc, search info from internet, look data from Google Maps.

I can even integrate this to home assistant and talk to my agent with my open source Alexa-like system.

mayank 14 minutes ago | parent [-]

Oddly enough, I did the exact same thing this past weekend, for a couple hundred usd in Fable overage.

It was truly remarkably easy to build and package it exactly to my whims, in my case as a single docker container with a process reaper that runs llama, my Go code, tts, chat harness, browser in xvfb, and even a mailer daemon. With Gemma, it even runs on a RPi 5.

What’s absolutely wild to me is that over a couple hours, I could probably have it import parts of Home Assistant for my devices directly, and do other wacky stuff in what is essentially software for one.

loufe 35 minutes ago | parent | prev | next [-]

This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways.

What would be useful is a cost metric. I'm curious how much I'd be willing to spend as a premium to not have those companies piping my conversations directly to the NSA. Maybe only some conversations? Claude and OpenAI are heavily subsidized, by all accounts, so Kimi K3 on a private endpoint might end up costing more or less - that's what I want to know.

mayank 23 minutes ago | parent [-]

I was curious about the cost angle too, i.e. how much "free" coding agent I can get for what cost. Here's the research by Fable if you're interested: https://claude.ai/public/artifacts/2c9a5001-0b7e-4944-beb1-9...

m_ke 39 minutes ago | parent | prev | next [-]

GLM 5.2 feels better than Opus and K3 is as good as Fable.

Now I can't wait for someone to distill K3 into a Qwen 3.6 27b or Poolside S 2.1 sized models for a proper fast local Composer 2.5 replacement.

spicyusername 12 minutes ago | parent | prev | next [-]

Something I've been thinking about a lot is that this new technology's primary UI is natural language. Human's are REALLY primed for natural language.

If it sounds good it must be good. The code this new model writes is incredible! It told me so!

sudo_cowsay 31 minutes ago | parent | prev | next [-]

I love OpenCode and the blankness of it too. Clean, light, and manual. It's a good change of pace from what we are used to on the internet (very cool but slow). Also, can you hmu with that modal plan XD

roywiggins 23 minutes ago | parent [-]

Pi Agent is even leaner feeling, it's worth a try.

khimaros 42 minutes ago | parent | prev | next [-]

this seems to be an advertisement for Modal. is it really your own infrastructure if the hardware is leased?

nujabe 34 minutes ago | parent | prev | next [-]

This is such a poor quality post, reads more like a diary entry than a substantive technical post.

PontifexCipher 28 minutes ago | parent | next [-]

https://en.wikipedia.org/wiki/Blog

nujabe 11 minutes ago | parent | next [-]

??

sroerick 12 minutes ago | parent | prev [-]

lol

Gigachad 15 minutes ago | parent | prev [-]

I will take 5000 "diary entry" blog posts over LLM generated walls of text that say nothing.

People need to learn to just post the prompt rather than the LLM output which just fluffs the prompt.

jdw64 40 minutes ago | parent | prev | next [-]

Actually, if you break tasks down into small enough units, there's not much difference between open models and closed models. The only reason to use agents is the hope that they'll work with natural language input—but that's where the difficulty lies.

For example, if you modify things at the level of small functions, open models seem to perform just as wel

paradox460 32 minutes ago | parent | next [-]

Yup. Been using big expensive models like opus, gpt, or glm for planning, then switch to something like gpt-oss-120B on cerebras and watch it fly. Total cost will be less than $5 for even very large tasks

jdw64 13 minutes ago | parent [-]

People tend to think alike. I work in much the same way.First, I write the draft myself, then let AI handle the revisions, and finally run it through an open model in small units before I check the results.

verdverm 7 minutes ago | parent | prev [-]

I think this is where they say "loop engineering" / orchestration comes in, though I would also include context/harness engineering in the toolbox

irishcoffee an hour ago | parent | prev [-]

It surprises me that this concept took as long as it did to gain traction in… hacker news. 15 years ago folks here were compiling kernels and gentoo distros. Lately it’s been “you should just pay the man, it’s cheaper than running these things yourself”

loire280 37 minutes ago | parent | next [-]

Rolling your own Linux is nearly free and could be done on any computer you had lying around. Dropping >$5k on a computer to run a local model (badly) doesn't really scratch my "hacker" itch. The author of this article works for an AI infrastructure company and ran Kimi K3 on their infrastructure - this post reads like marketing.

eru 32 minutes ago | parent | prev | next [-]

It's fairly easy (and cheap!) to run your own email server, but most people don't bother and just use gmail. And rightly so!

brcmthrowaway an hour ago | parent | prev [-]

Rsync the dropbox, dude