Remix.run Logo
benjiro29 3 hours ago

I really do not understand how software developer think anymore. Using a LLM to translate a project in a short time, is by itself incredible. Just like one-shot whatever office clone.

But what makes software is not the fast creation of a "product" but that actual development of its features. Figuring out how everything needs to work together, fixing the bugs, and the o so boring UI work.

I have used LLMs to create stuff like word clones just for fun. It was a disaster. Sure, it had the basic functionality. But the moment you started with page structure (harder then one non-stop scrolling page), tables, images, rotating, and so many details that make up just the basics of word. Not even the extended functionality. You see every LLM just fall on its face.

Sure, i can clone sqlite from c to rust. Hell, i may even get it to do all the tests 100%. But there is a 99% chance that the clone will be slower, as it lacks the years of optimizations from the original language. There will be new bugs because of the language changeover. There is a need for future support and fixes.

People threat software like its something it is not. But unlike the past where your clients question your sanity for charging 100k for a piece of software. Not understanding its not just about writing the code. Now those expectation are even more pushed forwards, because of articles like this.

I constantly see software being published on reddit that does X, Y, Z only for the authors to abandon it as fast as they vibe coded it. Because fixing bugs is NOT sexy. Even with a LLM at your fingertips. Dealing with nagging users, is not sexy. Dealing with security issues, is NOT sexy. Dealing with data structure / databases, especially as your system changes ... you get the point.

Not understanding to the core the software you wrote, is going to exploded in your face.

This is why these stupid "we rewrote X into Z with a LLM in Y days" mean nothing. Its one thing to get a head start using this trick, its another to actually learn the code of your rewrite. And dedicated the time into maintaining the port, growing it, fixing it. This is where a lot of software fails. But now this crap is out there, instead of the maintained version of Zig, now we have a unmaintained Rust version that clouded the airwaves because if people now search for it, those articles "X in Z days" will pop up.

What have we become ...

whstl 2 hours ago | parent | next [-]

I think this is perfectly fine.

If you explore Github, you're gonna see thousands of abandoned game engines, compilers for made-up languages. And that has been happening since before the LLM era.

I used to be part of an OS messaging board in the early 2000s and almost everyone had their own OS. A dozen people or so could even run Firefox! I remember (now legend) Terry bothering us to check out LoseThos or GodOS or whatever was its name, but quite a few people had OSs that could do more than that.

Not all software needs to be commercial to be useful, even if it's just for a learning experience. I have learned a lot from those experiments, even if they're not polished.

lelanthran an hour ago | parent | next [-]

> If you explore Github, you're gonna see thousands of abandoned game engines, compilers for made-up languages. And that has been happening since before the LLM era.

Yeah, but the people authoring those learned something.

> I used to be part of an OS messaging board in the early 2000s and almost everyone had their own OS.

Great example! I, too, once had my own toy OS, and browsed OSDev wiki nonstop. The thing is no one in the OS dev community were writing things they intended to place in front of actual users!

The difference now is that these incomplete projects:

a) Don't leave their owners any wiser than when they started, and

b) Are actually intended by their owners to be used by actual users.

> I have learned a lot from those experiments, even if they're not polished.

Would you have learned as much if you told a magic box "Make me an OS" and then slapped your name on it and uploaded it to GH?

nihsett an hour ago | parent [-]

Probably not, but sometimes I wonder if the lowered activation bump lets more people try it, even if they just vibecode the whole thing, and maybe learn a thing or two in the process? They wouldn't learn as much as they would if they did it by hand, but they would've never done it by hand in the first place - so this is better maybe? I don't know. The whole field is in a weird place right now, all previous rules of thumb might be wrong.

SuddsMcDuff 2 hours ago | parent | prev | next [-]

> (now legend) Terry bothering us to check out LoseThos or GodOS or whatever was its name

Temple OS :)

dandelioness an hour ago | parent [-]

Dude was a tweaker xD

dymk 2 minutes ago | parent | next [-]

He had schizophrenia.

an hour ago | parent | prev [-]
[deleted]
piker 2 hours ago | parent | prev | next [-]

> Not all software needs to be commercial to be useful, even if it's just for a learning experience. I have learned a lot from those experiments, even if they're not polished.

This is fine so long as the author is learning something (questionable) and not polluting the commons with "I made this in a weekend" vibe slop.

Supermancho an hour ago | parent [-]

> This is fine so long as the author is learning something (questionable) and not polluting the commons with "I made this in a weekend" vibe slop.

Almost all of my prototypes are made this way. "I made this in a weekend", is more often, "I made this in a day". Like any trad-coded project, time to vibe code a backend vs frontend time is 1:N

2 hours ago | parent | prev | next [-]
[deleted]
boggo an hour ago | parent | prev [-]

LoseThOS didn't burn through hundreds of thousands of dollars of expensive and environmentally questionable compute.

sigbottle 2 hours ago | parent | prev | next [-]

The more technical you get, the more subsitutable you become - or at least, people think of it in that way, because the whole idea is "It's not me, or the people, it's the raw technical prowess that earns its keep in this place".

But it seems like we're finally starting to accept that "accidentals" like network effects, ownership, accountability, etc. are important. Of course, that's why many of us fled to technical corners in the first place - because the "accidentals" become tied up with things like nepotism, unfair and arbitrary judges from random humans who don't understand your merit, the need for bullshitting more than real technical value. Supposedly, anyways.

lackoftactics an hour ago | parent | next [-]

My thoughts too. The LLMs made me understand that the world had been working like that long before LLMs. Luck plays an enormous part in life. We gravitated toward a discipline that seemed free of all those problems, when in fact it had those downfalls better disguised.

germandiago 2 hours ago | parent | prev [-]

I think it is a very good point: "because the "accidentals" become tied up with things like nepotism, unfair and arbitrary"

I never thought of this from this perspective but indeed it seems to be totally true.

Aurornis 2 hours ago | parent | prev | next [-]

> Its one thing to get a head start using this trick, its another to actually learn the code of your rewrite.

I worked for a startup that stopped feature development and did a complete rewrite of a huge codebase. I was assigned to a side project during this time and missed the entire rewrite process. I came back to a completely rewritten codebase.

There was almost no learning curve, despite being in an entirely different language. The core architecture, data structures, and concepts were the same.

If you read the Bun blog post on how they did it, their rewrite was similar: The first step was getting it into a new language, not rearchitecting it from scratch.

I think they did it the right way based on my pre-LLM. Rewriting into a different language as fast and basically as possible is important for getting the team switched over quickly. Rewriting into a different language in X days is actually a good goal to minimize.

nicce 41 minutes ago | parent [-]

> There was almost no learning curve, despite being in an entirely different language. The core architecture, data structures, and concepts were the same.

> If you read the Bun blog post on how they did it, their rewrite was similar: The first step was getting it into a new language, not rearchitecting it from scratch

They eventually might regret this, when they are trying to get rid of the last lines of unsafe code. Rust needs to be written differently before you can write safe things to perform fast when compared to other languages or unsafe code. It takes a lot of experience before you can see it.

ChoGGi 2 hours ago | parent | prev | next [-]

> I constantly see software being published on reddit that does X, Y, Z only for the authors to abandon it as fast as they vibe coded it.

Also if you whip something up, you tend not to care for it as much as something you took the time to create in a "proper" manner.

nope1000 2 hours ago | parent | prev | next [-]

Also I think porting code to another language or rewriting is one of the easier tasks for an LLM, since it has an extremely detailed spec (the source code itself) and a ton of tests already (hopefully).

galangalalgol 2 hours ago | parent [-]

In my experience, it will go to every length to convince you it has ported code that it hasn't. It will silently drop upstream unit tests it has no code for, if questioned it will insert some markdown giving some rational why that specific bit was deferred, after the fact, and then point you to it. This was Opus 4.6 for reference. I have had much better luck with small numbers of higher level tests that I can individually verify equivalency. I haven't tried having it do differential fuzzing on some high level interface, that seems like it might work in some cases. But to summarize, treat it like an adversary trying to deceive you.

furyofantares 3 hours ago | parent | prev | next [-]

> I have used LLMs to create stuff like word clones just for fun. It was a disaster. Sure, it had the basic functionality. But the moment you started with page structure (harder then one non-stop scrolling page), tables, images, rotating, and so many details that make up just the basics of word. Not even the extended functionality. You see every LLM just fall on its face.

What do you think of https://scramblequest.app and https://wordpeek.app ?

I have never looked at any of the code for them

edit: Yeesh, misread your comment as "word games" not "word clones" and was very confused about the claim. Probably should have noted my confusion and re-read.

TaLiTr 3 hours ago | parent | next [-]

I think they might mean Word as in Microsoft Word. Just based on the feature list they were describing.

oblio 3 hours ago | parent | prev | next [-]

Are you comparing 2 relatively simple games with... Word?

Word is basically an operating system. Unix people like to make fun of Emacs for being one, but Word is basically one, too. And all the features in there are used, otherwise Microsoft wouldn't keep them around.

reddalo 2 hours ago | parent | next [-]

>Word is basically an operating system.

And .doc files are basically a memory dump.

galangalalgol 2 hours ago | parent | next [-]

That was certainly true once, but now all that state is serialized to xml amd zipped up. You can unzip it and look at it if you don't value your sanity.

oblio an hour ago | parent [-]

So what you're saying is that the files are basically a memory dump formatted as XML? :-p

galangalalgol an hour ago | parent [-]

A selective menory dump that when deserialized can ignore fields not present its version, but yeah.

someguyiguess 2 hours ago | parent | prev [-]

Dump is a great word for it

furyofantares 3 hours ago | parent | prev [-]

Haha, I misread as "word games" and was very confused about the claim.

rurban 3 hours ago | parent | prev [-]

Nonsense. Provide/create proper tests for all features, and let the LLM test and fix everything.

In case of ccc (claudes C compiler) they just did not use any tests, though they are many existing C testsuite. They just stopped, when it finished compiling the kernel, still failing hundreds of tests.

3 hours ago | parent [-]
[deleted]
someguyiguess 2 hours ago | parent | prev | next [-]

It’s strange how you think AI is some static thing that only produces the type of output you experienced and isn’t constantly improving. My experience has proven the latter time and time again.

otabdeveloper4 2 hours ago | parent | prev [-]

> Using a LLM to translate a project in a short time, is by itself incredible.

Not really. Transpilers have existed since forever.

The hard part is all the edge cases. (And LLMs don't solve this problem; they probably akshually exacerbate it.)