Remix.run Logo
JimmaDaRustla 12 hours ago

> LLMs could hit an unsolvably hard wall next year and settle into a niche of utility

LLMs in their current state have integrated into the workflows for many, many IT roles. They'll never be niche, unless governing bodies come together to kill them.

> I can't find a single open source codebase, actively used in production, and primarily maintained and developed with AI

Straw man argument - this is in no way a metric for validating the power of LLMs as a tool for IT roles. Can you not find open source code bases that leverage LLMS because you haven't looked, or because you can't tell the difference between human and LLM code?

> If this is so foundationally groundbreaking, that should be a clear signal.

As I said, you haven't been paying attention.

Denialism - the practice of denying the existence, truth, or validity of something despite proof or strong evidence that it is real, true, or valid

NilMostChill 11 hours ago | parent | next [-]

> LLMs in their current state have integrated into the workflows for many, many IT roles. They'll never be niche, unless governing bodies come together to kill them.

That is an exaggeration, it is integrated into some workflows, usually in a provisional manner while the full implications of such integrations are assessed for viability in the mid to long term.

At least in the fields of which i have first hand knowledge.

> Straw man argument - this is in no way a metric for validating the power of LLMs as a tool for IT roles. Can you not find open source code bases that leverage LLMS because you haven't looked, or because you can't tell the difference between human and LLM code?

Straw man rebuttal, presenting an imaginary position in which this statement is doesn't apply doesn't invalidate the statement as a whole.

> As I said, you haven't been paying attention.

Or alternatively you've been paying attention to a selective subset of your specific industry and have made wide extrapolations based on that.

> Denialism - the practice of denying the existence, truth, or validity of something despite proof or strong evidence that it is real, true, or valid

What's the one where you claim strong proof or evidence while only providing anecdotal "trust me bro" ?

jdiff 10 hours ago | parent | prev | next [-]

> LLMs in their current state have integrated into the workflows for many, many IT roles. They'll never be niche, unless governing bodies come together to kill them.

Having a niche is different from being niche. I also strongly believe you overstate how integrated they are.

> Straw man argument - this is in no way a metric for validating the power of LLMs as a tool for IT roles. Can you not find open source code bases that leverage LLMS because you haven't looked, or because you can't tell the difference between human and LLM code?

As mentioned, I have looked. I told you what I found when I looked. And I've invited others to look. I also invited you. This is not a straw man argument, it's making a prediction to test a hypothesis and collecting evidence. I know I am not all seeing, which is why I welcome you to direct my eyes. With how strong your claims and convictions are, it should be easy.

Again: You claim that AI is such a productivity boost that it will rock the IT industry to its foundations. We cannot cast our gaze on closed source code, but there are many open source devs who are AI-friendly. If AI truly is a productivity boost, some of them should be maintaining widely-used production code in order to take advantage of that.

If you're too busy to do anything but discuss, I would instead invite you to point out where my reasoning goes so horrendously off track that such examples are apparently so difficult to locate, not just for me, but for others. If one existed, I would additionally expect that it would be held up as an example and become widely known for it with as often as this question gets asked. But the world's full of unexpected complexities, if there's something that's holding AI back from seeing adoption reflected in the way I predict, that's also interesting and worth discussion.

dingnuts 12 hours ago | parent | prev [-]

> Can you not find open source code bases that leverage LLMS because you haven't looked, or because you can't tell the difference between human and LLM code?

The money and the burden of proof are on the side of the pushers. If LLM code is as good as you say it is, we won't be able to tell that it's merged. So, you need to show us lots of examples of real world LLM code that we know is generated, a priori, to compare

So far most of us have seen ONE example, and it was that OAuth experiment from Cloudflare. Do you have more examples? Who pays your bills?

cdelsolar 11 hours ago | parent [-]

What are you talking about? I have multiple open-source projects where I've generated multiple PRs with 90+% AI tools. I don't care that the code isn't as good, because I have people using these features and the features work.

1) https://github.com/domino14/Webolith/pull/523/files (Yes, the CSS file sucks. I tried multiple times to add dark mode to this legacy app and I wasn't able to. This works, and is fine, and people are using it, and I'm not going to touch it again for a while)

2) https://github.com/domino14/macondo/pull/399 - A neural net for playing Scrabble. Has not been done before, in at least an open-source way, and this is a full-fledged CNN built using techniques from Alpha Zero, and almost entirely generated by ChatGPT o3. I have no idea how to do it myself. I've gotten the net to win 52.6% of its games against a purely static bot, which is a big edge (trust me) and it will continue to increase as I train it on better data. And that is before I use it as an actual evaluator for a Monte Carlo bot.

I would _never_ have been able to put this together in 1-2 weeks when I am still working during the day. I would have had to take NN classes / read books / try many different network topologies and probably fail and give up. Would have taken months of full-time work.

3) https://github.com/woogles-io/liwords/pull/1498/files - simple, but one of many bug fixes that was diagnosed and fixed largely by an AI model.

ModernMech 9 hours ago | parent [-]

I think this is what the original poster means. The value proposition isn't "As a developer, AI will allow you to unlock powers you didn't have before and make your life easier". They're selling it as "AI can do you job."

We are being sold this idea that AI is able to replace developers, wholesale. But where are the examples? Seemingly, every example proffered is "Here's my personal project that I've been building with AI code assistants". But where are the projects built by AI developers (i.e. not people developers)? If AI was as good as they say, there should be some evidence of AI being able to build projects like this.