Remix.run Logo
nickandbro 4 hours ago

I feel like we are just inching closer and closer to a world where rapid iteration of software will be by default. Like for example a trusted user makes feedback -> feedback gets curated into a ticket by an AI agent, then turned into a PR by an Agent, then reviewed by an Agent, before being deployed by an Agent. We are maybe one or two steps from the flywheel being completed. Or maybe we are already there.

chatmasta 4 hours ago | parent | next [-]

I love everything about this direction except for the insane inference costs. I don’t mind the training costs, since models are commoditized as soon as they’re released. Although I do worry that if inference costs drop, the companies training the models will have no incentive to publish their weights because inference revenue is where they recuperate the training cost.

Either way… we badly need more innovation in inference price per performance, on both the software and hardware side. It would be great if software innovation unlocked inference on commodity hardware. That’s unlikely to happen, but today’s bleeding edge hardware is tomorrow’s commodity hardware so maybe it will happen in some sense.

If Taalas can pull off burning models into hardware with a two month lead time, that will be huge progress, but still wasteful because then we’ve just shifted the problem to a hardware bottleneck. I expect we’ll see something akin to gameboy cartridges that are cheap to produce and can plug into base models to augment specialization.

But I also wonder if anyone is pursuing some more insanely radical ideas, like reverting back to analog computing and leveraging voltage differentials in clever ways. It’s too big brain for me, but intuitively it feels like wasting entropy to reduce a voltage spike to 0 or 1.

throwaw12 37 minutes ago | parent | next [-]

> I love everything about this direction except for the insane inference costs.

If this direction holds true, ROI cost is cheaper.

Instead of employing 4 people (Customer Support, PM, Eng, Marketing), you will have 3-5 agents and the whole ticket flow might cost you ~20$

But I hope we won't go this far, because when things fail every customer will be impacted, because there will be no one who understands the system to fix it

mastermage 2 hours ago | parent | prev | next [-]

I mean theoretically if there are many competitiors the costs of the product should generally drop because competition.

Sadly enough I have not seen this happening in a long time.

eksu 3 hours ago | parent | prev [-]

This is the wrong way to see it. If a technology gets cheaper, people will use more and more and more of it. If inference costs drop, you can throw way more reasoning tokens and a combination of many many agents to increase accuracy or creativity and such.

Leptonmaniac 3 hours ago | parent | prev | next [-]

I think that as a user I'm so far removed from the actual (human) creation of software that if I think about it, I don't really care either way. Take for example this article on Hacker News: I am reading it in a custom app someone programmed, which pulls articles hosted on Hacker News which themselves are on some server somewhere and everything gets transported across wires according to a specification. For me, this isn't some impressionist painting or heartbreaking poem - the entity that created those things is so far removed from me that it might be artificial already. And that's coming from a kid of the 90s with some knowledge in cyber security, so potentially I could look up the documentation and maybe even the source code for the things I mentioned; if I were interested.

slopinthebag 2 hours ago | parent [-]

Art is and has always been about the creator.

vntok 25 minutes ago | parent [-]

Take a walk in any museum, I'm pretty sure you'll react to some of the art displayed there and find it cool before you read the name of the artist.

theredbeard 2 hours ago | parent | prev | next [-]

We haven’t been inching closer to users writing a half-decent ticket in decades though.

aembleton an hour ago | parent [-]

Maybe the agent can ask the user clarifying questions. Even better if it could do it at the point of submission.

heavyset_go 2 hours ago | parent | prev | next [-]

Feedback loops like that would be an exercise in raising garbage-in->garbage-out to exponential terms.

It's the "robots will just build/repair themselves" trope but the robots are agents

TeMPOraL an hour ago | parent [-]

Yes. Next they'll want nanobots that build/repair themselves.

Oh wait. That's already here and is working fine.

jvuygbbkuurx 4 hours ago | parent | prev | next [-]

Tusted user like Jia Tan.

mindwok an hour ago | parent | prev | next [-]

I think Anthropic will launch backend hosting off the back of their Bun acquisition very soon. It makes sense to basically run your entire business out of Claude, and share bespoke apps built by Claude code for whatever your software needs are.

tuo-lei 2 hours ago | parent | prev | next [-]

The missing piece for me is post-hoc review.

A PR tells me what changed, but not how an AI coding session got there: which prompts changed direction, which files churned repeatedly, where context started bloating, what tools were used, and where the human intervened.

I ended up building a local replay/inspection tool for Claude Code / Cursor sessions mostly because I wanted something more reviewable than screenshots or raw logs.

edf13 2 hours ago | parent | prev | next [-]

Or perhaps we end up where all software is self evolving via agents… adjusting dynamically to meet the users needs.

PeterStuer an hour ago | parent [-]

The "user" being the one that's in charge of the AI, not the person on the receiving end.

eru 2 hours ago | parent | prev | next [-]

Instead of having a trusted user, you can also do statistics on many users.

(That's basically what A/B testing is about.)

slopinthebag 3 hours ago | parent | prev | next [-]

What kind of software are people building where AI can just one shot tickets? Opus 4.6 and GPT 5.4 regularly fail when dealing with complicated issues for me.

withinboredom 3 hours ago | parent | next [-]

Not just complicated, but even simple ones if the current software is too “new” of a pattern they’ve never seen before or trained on.

slopinthebag 3 hours ago | parent [-]

I dunno if Rust async or native platform API's which have existed for years count as new patterns, but if you throw even a small wrench in the works they really struggle. But that's expected really when you look at what the technology is - it's kind of insane we've even gotten to this point with what amounts to fancy autocomplete.

victorbjorklund 2 hours ago | parent | prev | next [-]

Of course not all tickets are complex. Last week I had to fix a ticket which was to display the update date on a blog post next to the publish date. Perfect use case for AI to one shot.

thin_carapace 3 hours ago | parent | prev [-]

i dont see anyone sane trusting ai to this degree any time soon, outside of web dev. the chances of this strategy failing are still well above acceptable margins for most software, and in safety critical instances it will be decades before standards allow for such adoption. anyway we are paying pennies on the dollar for compute at the moment - as soon as the gravy train stops rolling, all this intelligence will be out of access for most humans. unless some more efficient generalizable architecture is identified.

heavyset_go 2 hours ago | parent | next [-]

> as soon as the gravy train stops rolling, all this intelligence will be out of access for most humans. unless some more efficient generalizable architecture is identified.

All Chinese labs have to do to tank the US economy is to release open-weight models that can run on relatively cheap hardware before AI companies see returns.

Maybe that's why AI companies are looking to IPO so soon, gotta cash out and leave retail investors and retirement funds holding the bag.

PeterStuer 2 hours ago | parent | next [-]

They could still eliminate relatively cheap hardware.

thin_carapace 2 hours ago | parent | prev [-]

i was under the impression that we were approaching performance bottlenecks both with consumer GPU architecture and with this application of transformer architecture. if my impression is incorrect, then i agree it is feasible for china to tank the US economy that way (unless something else does it first)

heavyset_go an hour ago | parent [-]

I think it just needs to be efficient or small enough for companies to deploy their own models on their hardware or cloud, for more inference providers to come out of the woodwork and compete on price, and/or for optimized models to run locally for users.

Regarding the latter, smaller models are really good for what they are (free) now, they'll run on a laptop's iGPU with LPDDR5/DDR5, and NPUs are getting there.

Even models that can fit in unified 64GB+ memory between CPU & iGPU aren't bad. Offloading to a real GPU is faster, but with the iGPU route you can buy cheaper SODIMM memory in larger quantities, still use it as unified memory, eventually use it with NPUs, all without using too much power or buying cards with expensive GDDR.

Qwen-3.5 locally is "good enough" for more than I expected, if that trend continues, I can see small deployable models eventually being viable & worthy competition, or at least being good enough that companies can run their own instead of exfiltrating their trade secrets to the worst people on the planet in real-time.

m00x 3 hours ago | parent | prev | next [-]

Several fintechs like Block and Stripe are boasting thousands of AI-generated PRs with little to no human reviews.

Of course it's in the areas where it doesn't matter as much, like experiments, internal tooling, etc, but the CTOs will get greedy.

slopinthebag 3 hours ago | parent | next [-]

I don't think anybody is doubting its ability to generate thousands of PR's though. And yes, it's usually in the stuff that should have been automated already regardless of AI or not.

thin_carapace 2 hours ago | parent | prev [-]

these companies contribute to swathes of the west's financial infrastructure, not quite safety critical but critical enough, insane to involve automation here to this degree

slopinthebag 3 hours ago | parent | prev [-]

Even in webdev it rots your codebase unchecked. Although it's incredibly useful for generating UI components, which makes me a very happy webslopper indeed.

thin_carapace 2 hours ago | parent [-]

im grateful to have never bothered learning web dev properly, it was enlightening witnessing chat gpt transform my ten second ms paint job into a functional user interface

hyperionultra 2 hours ago | parent | prev | next [-]

"Trusted user" also can be an Agent.

bredren 3 hours ago | parent | prev | next [-]

What you're describing is absolutely where we're headed.

But the entire SWE apparatus can be handled.

Automated A/B testing of the feature. Progressive exposure deployment of changes, you name it.

tossandthrow 4 hours ago | parent | prev | next [-]

I think the Ai agent will directly make a PR - tickets are for humans with limited mental capacity.

At least in my company we are close to that flywheel.

_puk 3 hours ago | parent | next [-]

Tickets need to exist purely from a governance perspective.

Tickets may well not look like they do now, but some semblance of them will exist. I'm sure someone is building that right now.

No. It's not Jira.

tossandthrow 3 hours ago | parent [-]

Yes, so my point is that PRs act as that governance layer - with preview environments, you can see the complexity and risk of the change etc.

Gigachad 3 hours ago | parent | prev [-]

The agents have even more limited capacity

eru 2 hours ago | parent [-]

At the moment, maybe. But it's growing.

Gigachad an hour ago | parent [-]

Even so they would probably still benefit from intermediate organisational steps.

eru an hour ago | parent [-]

For a while, sure.

overfeed an hour ago | parent | prev | next [-]

> I feel like we are just inching closer and closer to a world where rapid iteration of software will be by default.

There's a lots of experimentation right now, but one thing that's guaranteed is that the data gatekeepers will slam the door shut[1] - or install a toll-booth when there's less money sloshing about, and the winners and losers are clear. At some point in the future, Atlassian and Github may not grant Anthropic access to your tickets unless you're on the relevant tier with the appropriate "NIH AI" surcharge.

1. AI does not suspend or supplant good old capitalism and the cult of profit maximization.

MattGaiser 4 hours ago | parent | prev | next [-]

I am already there with a project/startup with a friend. He writes up an issue in GitHub and there is a job that automatically triggers Claude to take a crack at it and throw up a PR. He can see the change in an ephemeral environment. He hasn't merged one yet, but it will get there one day for smaller items.

I am already at the point where because it is just the two of us, the limiting factor is his own needs, not my ability to ship features.

jondwillis 3 hours ago | parent | next [-]

Why doesn’t he merge them?

m00x 3 hours ago | parent | prev [-]

Must be nice working on simple stuff.

yieldcrv 4 hours ago | parent | prev | next [-]

We do feedback to ticket automatically

We dont have product managers or technical ticket writers of any sort

But us devs are still choosing how to tackle the ticket, we def don't have to as I’m solving the tickets with AI. I could automate my job away if I wanted, but I wouldn't trust the result as I give a degree of input and steering, and there’s bigger picture considerations its not good at juggling, for now

charcircuit 4 hours ago | parent | prev | next [-]

Then sets up telemetry and experiments with the change. Then if data looks good an agent ramps it up to more users or removes it.

eranation 3 hours ago | parent | prev [-]

Um, we are already there...