Remix.run Logo
malfist 2 days ago

> the cost/benefit of LLMs for coding changed sharply just a month or two after this

People say this every month.

tptacek 2 days ago | parent | next [-]

Do they? I'm referring to something specific. While I happen to think LLM coding agents are pretty great, my point didn't depend on you thinking that, only on a recognition of the fact that the capabilities of these systems sharply changed very shortly after they published this --- in a very specific, noticeable way.

sothatsit 2 days ago | parent | prev [-]

Marketing people say this every month, but that doesn't mean there haven't also been actual step-changes in AI-assisted coding in the last year.

The policy is dated to 2024-04-14. After they approved this, there were all of these releases that were all pretty dramatic advancements for coding: 3.5 Sonnet (for taste + agentic coding), o1-preview (for reasoning), Claude Code (for developer experience), o3 (for debugging), Claude 4 Opus (for reliability), and now GPT-5 Pro (for code review).

We have advanced from AI that can unreliably help you look up documentation for tools like matplotlib, to AI tools that can write and review large complex programs in the last year alone. Sure, these tools still have a lot of deficiencies. But that doesn't negate the fact that the change in AI for coding in the last year has been dramatic.