| ▲ | Codex logging bug may write TBs to local SSDs(github.com) |
| 214 points by vantareed 6 hours ago | 120 comments |
| |
|
| ▲ | b--l 5 hours ago | parent | next [-] |
| Codex is one of the most infamous examples of slopware. Just having the window unhidden on my mac will cause it to use 100% of the GPU displaying the spinner message. THE SPINNER MESSAGE CAUSES 100% GPU USAGE ON AN MBP M5!! So any time you're waiting on the model (which is 90% of the time), your fans will be blasting (careful, don't use it on battery). The issue is on github and close to 6 months old. Probably since the release of vibe coded junk. I would literally fix it myself but it's closed source for whatever reason. There are many discussions about which model is better, or if vibe coding is even possible. I point you to the extent of what one of the most well funded, money flush, well staffed model making companies can do with vibe coding. To me a screwup this bad (where the CEO has already made it clear they're now "focussing on coding") indicates that there's something truly broken in the company. No one on polymarket expects them to have a leading model any time soon for example. It's a tragedy. The world needs competition to anthropic. |
| |
| ▲ | jofzar 4 hours ago | parent | next [-] | | > Codex is one of the most infamous examples of slopware Woah, let's not forget Claude code is right there | | |
| ▲ | me551ah 11 minutes ago | parent | next [-] | | Claude is also weird for being the only coding assistant that for some reason doesn't support AGENTS.md. Codex, Amp, Cursor all of them support it and read from it, but not claude which forces it's users to use CLAUDE.md instead. The issue is the higest voted issue on their gitlab repo: https://github.com/anthropics/claude-code/issues/6235 | |
| ▲ | kokada 3 hours ago | parent | prev | next [-] | | Not that Claude Code is much better, I just hit this issue[1] because it seems setting DO_NOT_TRACK=1 seems enough to get a really strange behavior in the newest versions of CC. [1]: https://github.com/anthropics/claude-code/issues/69238#issue... Edit: I think I misunderstood OP, they're saying that CC is even worse and not better than Codex CLI. | |
| ▲ | varjag 2 hours ago | parent | prev | next [-] | | Right, just yesterday I found my laptop kinda hot. And what do you think, it was good old Claude deciding to load a few cores with completely idling prompts. | |
| ▲ | mvATM99 4 hours ago | parent | prev | next [-] | | Yeah exactly. I'm not exactly building TUI's every day, but even i felt pain when i read that "small game engine" post | | |
| ▲ | matheusmoreira an hour ago | parent | next [-] | | At least game engines manage to render their frames properly. Claude Code sometimes eats entire paragraphs of text output, resulting in things such as numbered lists jumping from 2 to 4 out of nowhere. I'd just ask Claude to repeat himself at first but it happens so often that I actually made a little tool to dig up the output inside the session history and present it properly in a separate terminal. | |
| ▲ | TacticalCoder an hour ago | parent | prev [-] | | > I'm not exactly building TUI's every day, but even i felt pain when i read that "small game engine" post The bigger issue is they where somehow thinking it was "cool" and "advanced" while it's just a kludgy rube-goldbergy monstrous hack. Which is of course only semi-working: to me the model thinking what you see is what it outputs in the TUI is the deal-breaker for me. It's of course not working like that for they're apparently, in their "game engine", converting on the fly a headless browser to approximated characters to display in the terminal. So the model tells you he did output ASCII but people are copy/pasting (because, yes, at times you want to copy/paste) Unicode chars. Plenty of bug reports and pissed users. That's the bigger issue. The biggest issue is those thinking a 10 GB VM required to run a headless Electron browser and then fuxx0ring characters conversion is somehow an achievement. | | |
| |
| ▲ | iLoveOncall an hour ago | parent | prev [-] | | Surprisingly Kiro is fine (I work at Amazon but not at all on the Kiro team). I prefer it to anything else I've tried (except Amazon Q Developer in IntelliJ, but it's now deprecated). |
| |
| ▲ | r_lee 3 hours ago | parent | prev | next [-] | | if we are at 10x with AI and near AGI or ASI, then how is it possible that these products (Codex, Claude Code CLI) are still such garbage? shouldn't this "agentic AI revolution" have long solved this already? no way they're over there saying "we are on it plz wait" or that "it's too much effort"? | | |
| ▲ | hombre_fatal an hour ago | parent | next [-] | | Like anything, you have to decide between polish vs switch to any other task in the queue. If you choose too much from the latter, then polish suffers, yet that's a human thing. Also, Codex and Claude Code aren't as bad as people say. I think most of the noise is embellished by the "hah see? AI sucks" angle. It's kind of like how HNers would claim to your face that you can't actually build anything with Javascript and Node.js (JS just sucks too much), then they'd list off a few footguns that were supposed to demonstrate why. In other words, champing at the bit for JS to lead people to catastrophize issues that were pretty mediocre. | | |
| ▲ | coldtea 7 minutes ago | parent [-] | | >Like anything, you have to decide between polish vs switch to any other task in the queue Why do you "have to decide"? Let some agents go at both of those, isn't that what they claim people can just do? >Also, Codex and Claude Code aren't as bad as people say. I think most of the noise is embellished by the "hah see? AI sucks" angle. Why shouldn't it? They're not the ones making the extraordinary claims. |
| |
| ▲ | igleria 3 hours ago | parent | prev | next [-] | | This is the biggest elephant in the room I have seen in my decade+ career. At the same time, look how bad Apple is in software compared to its hardware... It's not an AI only problem, it's almost like software in general gets a free pass on being very unsafe or low quality because no one wants to face the same "profit reducing red tape" that civil engineers or similar face. | | |
| ▲ | CharlieDigital 2 hours ago | parent [-] | | Anthropic were the progenitors of the Model Context Protocol. Claude Code does not fully implement the client end of the protocol. A protocol; a literal pre-defined spec that an agent should be able to one-shot. Neither does Codex. Codex does not implement MCP Prompts. (I want Codex to implement MCP Prompts because then we have one central way to ship skills from a server). The fact that neither platform can implement a protocol given what is functionally infinite frontier model tokens really says a lot. I do not care what kind of random project some influencer can ship with a swarm of 1000 agents. If you cannot make the basics work, it is a farce. |
| |
| ▲ | mnicky an hour ago | parent | prev | next [-] | | If the code churn is high the investment to refactoring etc is less beneficial than may be obvious. I don't remember the details but I heard in some podcast that the code base of Claude Code changes so fast that any piece of code won't be there for long.. | | |
| ▲ | coldtea 5 minutes ago | parent [-] | | In other words it's an ever moving vibe fest, with random bugs and misbehaviors each time they roll the dice... |
| |
| ▲ | jeffybefffy519 2 hours ago | parent | prev | next [-] | | Because vibe coding is a toy… thats the secret. You can use it to accelerate development certainly, but that requires careful change->review cycles. The developer still needs to be in heavy control, versus vibe coding having an agent own the code base. | |
| ▲ | fg137 3 hours ago | parent | prev | next [-] | | You are asking too many good questions. | |
| ▲ | user43928 2 hours ago | parent | prev | next [-] | | The products generally work just fine on my MacBook. I have not encountered major issues in either the Claude Code CLI, the Codex Desktop app, or Claude Desktop app. They generally get the job done. I don't measure disk writes or analyze the GPU usage. | |
| ▲ | Zababa 2 hours ago | parent | prev [-] | | A simple explanation is that they are "good enough" for most people and they have better things to do. Even if tomorrow I was 100 times as productive, I still wouldn't have time to do literally everything and I would have to prioritize. | | |
| ▲ | coldtea 4 minutes ago | parent [-] | | You might not. But the Claude Code team has ONE job. And they have full access to a platform that they advertise as "humanity-threat" level good, and claim that it can automate everything code related... |
|
| |
| ▲ | markdog12 an hour ago | parent | prev | next [-] | | This software has been terrible for me. Burns tokens like crazy, and fails. Most times I try to use the browser plugin, it just says it can't use the plugin. When it does work, it takes minutes to click a button. Unusable workflow. I ask to generate a png with an alpha channel. It can't. Instead, it outputs a chroma-keyed image, then generates a python script to remove chroma key (fails), then a js script (which also fails). Then my 5h allotment is up. It's frustrating because if it worked as they advertise, it'd be an amazing tool. | | |
| ▲ | EMM_386 24 minutes ago | parent [-] | | Although they can technically do it, I wouldn't be asking LLMs to generate binary files like PNG with alpha channels, no matter how simple that may seem. If it's easy enough to manually create one yourself, I would do that. The best way for LLMs to do this is likely to write a scratch program (which is what it seems to have reached for in the second half), write code (which they are good at) and have the library create the image. At some point it is just easier to handle such things yourself, and use them with text-based formats. |
| |
| ▲ | nicce 3 hours ago | parent | prev | next [-] | | Not only Codex, but I can't leave ChatGPT app in macOS open for few hours, because it will consume 60 gigabytes of RAM over time and crashes all the apps. Mindboggling. Or can't use Google's AI Studio in browser because it takes 100% CPU. Need to write own app for everything??? | | |
| ▲ | veber-alex an hour ago | parent | next [-] | | ChatGPT works ok for me but Whatsapp consumes 1000% cpu after the mac wakes up after sleep. I swear a few years ago shit like this didn't happen on macOS. | | | |
| ▲ | porridgeraisin 3 hours ago | parent | prev [-] | | the damn chat.openai.com webapp lags a lot as well on long chats, typing takes so long. | | |
| ▲ | rsfern 41 minutes ago | parent [-] | | In my experience the input field lags on short chats too, sometimes in the middle of writing the second or third prompt. Are they running some kind of prospective evaluation or something? | | |
| ▲ | nicce 21 minutes ago | parent [-] | | When you are writing completely new prompt - it sends every character to server when writing and tries to make suggestions based on that. And keeps doing it in intervals in /prepare endpoint, during each prompt. So if you are working with something sensitive - don't write it to browser directly and edit it there. | | |
|
|
| |
| ▲ | xpct 4 hours ago | parent | prev | next [-] | | Well thank you for your service. I thought about trying out Codex after the disaster that is Claude Code. I'll be fine without either one on my machine | | |
| ▲ | jofzar 4 hours ago | parent | next [-] | | Imo codex is significantly better then Claude code for me ATM. | |
| ▲ | christophilus an hour ago | parent | prev | next [-] | | Codex is much better, which is to say, it’s only pretty bad. | |
| ▲ | comboy 4 hours ago | parent | prev [-] | | I mean, Codex CLI is really bad. But Claude's CLI is so much worse. Welcome to the world of tomorrow! |
| |
| ▲ | tengada1 18 minutes ago | parent | prev | next [-] | | I had the exact same frustration and switched to Pi and have had zero complaints | |
| ▲ | NamlchakKhandro 22 minutes ago | parent | prev | next [-] | | Pi mono is the only true harness. Everything else is crap | |
| ▲ | l33tman 5 hours ago | parent | prev | next [-] | | This was fixed long ago, if I'm thinking of the same bug. It was stuck in an inf loop all the time the codex window was open. | | |
| ▲ | cncjvu7 4 hours ago | parent [-] | | Nah it's still doing weird shit. Uninstalled that crapware last week. |
| |
| ▲ | xenator 2 hours ago | parent | prev | next [-] | | I have exactly the same problem with Time Machine spinner on macOS. It even doesn't rotate. Somewhere should be rare specialists with diploma who are capable of fixing such problems with waiting lists for years ahead. | |
| ▲ | seviu 3 hours ago | parent | prev | next [-] | | To be fair with Codex, you can use any harness you want with it. Access is not gatekeeper by a crappy full of slop electron app. So just move to PI, or whatever. Claude on the contrary, forces all plan users to use their horrible app, which, if you ever dared to use cowork, only once, will run a 2GB VM on app start, no f's given. at all. Not justifying it. But if you use the official Codex app, thats on you. If you use the official Claude app, it's because you are forced to. Sidenote unrelated to the post: since the Fable thing, and after serious thinking, I moved to open source models. I still have the basic OpenAI sub, but then easy lifting is now done elsewhere. | |
| ▲ | hokkos 3 hours ago | parent | prev | next [-] | | is it closed source ? i can see the rust code in repo contrary to the JS in claude code repo, are you mixing them up ? | | |
| ▲ | nicce 3 hours ago | parent [-] | | Codex CLI is the main Rust code. There is Codex Desktop separately, using Electron and the same Codex CLI. |
| |
| ▲ | jorl17 38 minutes ago | parent | prev | next [-] | | Claude code (desktop) and Codex (desktop) are both absolutely dogshit pieces of software. I can't pick which one is worse. I'd be sort of ashamed to say I actively worked on them, regardless of how they can empower people. Cursor's new UI is similarly terrible. They're all slowly getting better, but too slow for my taste. They are incredibly slow in unpredictable ways, eat up memory at an insane rate, and just feel like they were built with no regards for UX. Like they crammed together all the engineers with no idea of how to build a coherent and predictable UI and let them loose on the product without proper designers. The other day Codex (desktop) was eating up 70GB of RAM on my machine. What had I done? Literally nothing. I opened it and let it update once. Another one with Codex was when I had a specific conversation where no activity was happening and which would make the app spin up all of my CPU cores, rendering it barely usable. It would take seconds to react to anything or update the UI. The conversation wasn't even in focus!!! Restarting the app wouldn't help. After I archived it, it suddenly got better Claude Code Desktop used to be so, soo, soo slow and eat up so much RAM. It was unusable for anything other than playing around when I first tried it. It also didn't communicate any of what it would do. Using it was like living in a world with no affordances, constantly afraid of interacting with them and being faced with some sort of destructive action. Still, it has definitely been improving in terms of the UI experience. Cursor's new agents mode suffers from similar issues. Obscenely slow, hogging CPU without anything going on, breaking with existing UX patterns (some of them already well implemented in their other, more polished, previous version), confusing buttons and labels which don't explain what to do and that sometimes do destructive operations on your code. My favorite cursor absurdity is that if you use their workflow to create a worktree and the worktree setup script fails, the following happens: 1. The agent has no idea that it failed, let alone have any logs of the failure 2. Often you yourself don't get access to the logs of what failed in that script. Don't ask me, half the time it just says it failed with no further logs. 3. When you do get the logs, you cannot copy them in ANY way. You can't even select them. I have had to resort to taking a screenshot to do OCR on it I've also had cursor repeatedly have concurrency/race condition bugs when creating multiple worktrees in parallel. I have 5 tasks, I spin them up all together so they can create 5 worktrees and they crash with random internal cursor errors. Wasn't the point of this abhorrent new UI you've stuffed me with to enable parallelism? It's like people aren't even testing the shit they ship. Which I guess they aren't. I'm a big believer in AI and think it is changing the world and will continue to do so, but I almost get offended at how bad these products for which I am paying (sometimes quite a lot!) are. There's "move fast and break stuff" and then there's "build crap to call stuff". | |
| ▲ | energy123 3 hours ago | parent | prev [-] | | Let me guess, there's also a bug where they train on all our data? | | |
| ▲ | varjag 2 hours ago | parent [-] | | They don't need to. You pay them for the privilege to do black box reinforcement learning already. |
|
|
|
| ▲ | woadwarrior01 5 hours ago | parent | prev | next [-] |
| Someone posted a temporary workaround for this on X[1]. sqlite3 ~/.codex/logs_2.sqlite "CREATE TRIGGER IF NOT EXISTS block_log_inserts BEFORE INSERT ON logs BEGIN SELECT RAISE(IGNORE); END;" Also, I found that running VACUUM FULL on the sqlite file on my laptop shrunk it from 27GB to a mere 73MB[2]. [1]: https://xcancel.com/bdsqlsz/status/2067964486615810369 [2]: https://xcancel.com/jeethu/status/2068087449469780434 |
| |
| ▲ | NamlchakKhandro 20 minutes ago | parent [-] | | The real solution is to stop using it and switch to Pi | | |
| ▲ | woadwarrior01 7 minutes ago | parent [-] | | I’ve been using oh-my-pi with GLM-5.2 xhigh as the main model with GPT-5.5 medium from the codex sub as an advisor model. IMO, the combo works better than either of those models alone. |
|
|
|
| ▲ | christophilus 34 minutes ago | parent | prev | next [-] |
| Well, everyone's bashing on OpenAI as well they should, but just a reminder, unlike Claude Code, Codex is officially available to customize here: https://github.com/openai/codex It's fairly easy to patch. |
|
| ▲ | taspeotis 2 hours ago | parent | prev | next [-] |
| OpenAI really snatched defeat from the jaws of victory late last year when Claude Code was a laggy mess. Nowadays Codex has typing latency out of the gate, whereas Claude Code has the odd pause but generally displays my key presses as … you know … I press them. |
| |
| ▲ | kasey_junk an hour ago | parent | next [-] | | Fwiw I have the exact opposite experience. | |
| ▲ | christophilus an hour ago | parent | prev [-] | | I find Claude Code nearly unusable. I always have to type in neovim if I’m typing anything more than a few words. | | |
| ▲ | aquariusDue 33 minutes ago | parent [-] | | It runs fine for me on an old ThinkPad X220 loaded with 8 GB, an i5 and a barely working SATA SSD. This is on Fedora and Claude Code is installed from Anthropic's dnf repo (the latest channel). Granted I'm on the Pro Plan and I'm not running lots of sub agents but the default terminal app from KDE (Konsole) renders and keeps Claude Code responsive enough. I must be honestly missing some key piece of workflow otherwise I don't know why it would run so slow for other people on better hardware? Granted I'm taking care to tell Claude to not exhaust CPU cores and make sure to not trigger OOM errors, akin to "make no mistakes pls". |
|
|
|
| ▲ | altcognito 9 minutes ago | parent | prev | next [-] |
| I think part of the question should be, why is there no QA or test that catches this? It's one thing to be slopware, but why didn't anything run a test that catches this? |
| |
| ▲ | theowaway213456 2 minutes ago | parent [-] | | Every time you write a test that handles some data, you write an assertion about how much data is handled? Come on, this is such an easy thing to forget to test. Don't act like there is some magical testing strategy that would have caught this |
|
|
| ▲ | neuralkoi 4 hours ago | parent | prev | next [-] |
| Vibe coding takes "move fast and break things" to a whole nother level. |
| |
| ▲ | cryo32 4 hours ago | parent | next [-] | | Yeah. Here I am sitting on a major incident at our company because someone’s vibe coded shit went seriously wrong. | | |
| ▲ | al_borland 37 minutes ago | parent | next [-] | | I hope that ends up in the RCA, to show these tools as a real risk, and not swept under the rug, where all blame is shifted elsewhere. | | |
| ▲ | cryo32 31 minutes ago | parent [-] | | It'll go under the rug as it always does because no one wants to explain that our AI first strategy was a stupid one that caused a net negative ROI impact and reputational damage. |
| |
| ▲ | Imustaskforhelp 4 hours ago | parent | prev [-] | | Can you talk more in detail if possible and are allowed to do so? I do know one instance of someone literally losing a job because they vibe-coded their way to prod. Their response/justification was: "The code wasn't written by me. It was written by Claude/Chatgpt" They hadn't done anything to the database itself but you betcha that there are some horror stories involving database, lack of proper backups and Vibe-coding gone insanely wrong. | | |
| ▲ | cryo32 3 hours ago | parent | next [-] | | I can say very little in detail but basically Claude doesn’t have any conceptual idea of order of operations and transactional guarantees which resulted in producing something that failed under normal load. There is an evidence chain to suggest it was asked to do this but did not and that wasn’t verified. Our engineers are accountable for what they produce regardless of how so they are cleaning up the extensive mess this made. This will result in a very heated post-mortem meeting between the two factions in the company. | |
| ▲ | smoe 42 minutes ago | parent | prev | next [-] | | > "The code wasn't written by me. It was written by Claude/Chatgpt" That seems like a good way to justify your own job away. | |
| ▲ | flir an hour ago | parent | prev | next [-] | | > "The code wasn't written by me. It was written by Claude/Chatgpt" Culturally (across all LLM use, not just programming) we need to nip that in the bud. If we don't it's going to be the new "someone hacked my social media password" get out of jail free card for avoiding responsibility. I don't care what tools you used, but if your name is on it, you're the author and the responsibility is yours. No "it wasn't me it was my typewriter" bullshit. | |
| ▲ | latexr an hour ago | parent | prev [-] | | > Their response/justification was: "The code wasn't written by me. It was written by Claude/Chatgpt" It boggles the mind someone could think that is a valid justification, because ultimately what they’re saying is “I’m useless, what you get from me is the same thing as prompting the model” which still means they would lose their job. |
|
| |
| ▲ | comboy 3 hours ago | parent | prev | next [-] | | We are running out of things to break. | | | |
| ▲ | GL26 3 hours ago | parent | prev [-] | | as long as you don't have technical debt, vibe coding is mostly useful for prototyping. For a real product, true SWE will never be replaced | | |
| ▲ | Otek 2 hours ago | parent | next [-] | | Already got replaced at world top tier tech jobs. „True SWE” will be niche / luxury soon, just like real woodworking vs IKEA | | |
| ▲ | inigyou 2 hours ago | parent [-] | | Software is freely duplicable unlike wood. IKEA could be mass producing copies of the most beautiful chair in the world just as easily as it produces copies of something a 5-year-old drew in freecad. |
| |
| ▲ | throwatdem12311 an hour ago | parent | prev [-] | | all code is technical debt |
|
|
|
| ▲ | jofzar 4 hours ago | parent | prev | next [-] |
| This is actually such a classic blunder (shipping trace/debug logging on for everything), but funnily the impact is not in a normal way. It's crazy we have hit a point where memory, CPU speed and disk speed isn't getting clapped because a Dev shipped logging at trace level instead of what used to the application being catastrophically slow so its immediately fixed in the next update. |
| |
| ▲ | kuekacang 3 hours ago | parent [-] | | It helps too that agent work is done server side so you can hog all the local resources for your thin client. |
|
|
| ▲ | bravetraveler 3 hours ago | parent | prev | next [-] |
| Somebody please donate some tokens to this plucky startup, they need our help. |
|
| ▲ | whalesalad 8 minutes ago | parent | prev | next [-] |
| Yikes. I have a habit of leaving sessions open for a long time. I just ran `sudo iotop` to watch live disk activity and sure enough all my idle codex sessions were spinning away writing god knows what constantly to disk. |
|
| ▲ | i2km 4 hours ago | parent | prev | next [-] |
| Shocking. Been open a week and AFAICT just silence from OpenAI. I just find it baffling. You'd think that these vendors would be very sensitive to this sort of issue. I mean, surely they have multiple agents hooked up to github monitoring potential issues and proposing fixes, right? ...right? Surely it should be trivial for them to have their own tools spinning away trying to fix all the github issues in real time... |
|
| ▲ | ramon156 6 hours ago | parent | prev | next [-] |
| Blegh, I puke every time I see obviously AI generated comments in GH PR's. You cannot assume any of these people have done their research, other than telling Codex to do it for them |
| |
| ▲ | b--l 5 hours ago | parent [-] | | It's because they use gpt-5.5-xhigh (the money making* model) to build it. (*for them) |
|
|
| ▲ | sigbottle 2 hours ago | parent | prev | next [-] |
| I have noticed absurd lag from the browser usage and sometimes complete bricking of my network too on my computer. I thought it was just my computer getting old, but possibly it's ChatGPT. |
|
| ▲ | purpleidea 3 hours ago | parent | prev | next [-] |
| I want to like codex, but the quality is just not very good, especially when compared to Claude. It used to work okay, but a while back they landed a major regression for an entire team of folks I work with. No response, no workaround. https://github.com/openai/codex/issues/23762 |
| |
| ▲ | christophilus an hour ago | parent [-] | | I don’t trust any agent to respect any boundaries. They might today. But tomorrow’s vibe coded slip update might break it in subtle ways. My solution to this is to only run agents in a sandbox of my own making (a locked down Podman container). |
|
|
| ▲ | xfgong 2 hours ago | parent | prev | next [-] |
| Same issue with Claude Code btw — it writes massive debug logs to ~/.claude/logs. Had to symlink it to a tmpfs to stop wearing out my SSD. |
| |
|
| ▲ | bob1029 5 hours ago | parent | prev | next [-] |
| I'm struggling with how this much logging information could be generated at any level of verbosity. Is codex writing log entries while it's sitting idle? Why would someone want to look at these logs? |
|
| ▲ | ares623 5 hours ago | parent | prev | next [-] |
| i hope they find the smoking gun, the key insight, the kicker. |
| |
| ▲ | 59nadir 5 hours ago | parent | next [-] | | Then they can apply a clean solve, the cleanest solution. It's fascinating how offensive some of this verbiage becomes to you when you see it attached to LLM output too much. | | |
| ▲ | jofzar 4 hours ago | parent [-] | | Ugh this one's gets me so bad, same with "wire" and "wired" everything is wired to something. |
| |
| ▲ | wrxd an hour ago | parent | prev [-] | | At least they could call someone who’s is absolutely right so that the tool can see its mistakes now |
|
|
| ▲ | dundercoder 5 hours ago | parent | prev | next [-] |
| If something like this is helpful or necessary, that’s what ram backed tmpfs is for. |
| |
| ▲ | mrweasel 5 hours ago | parent [-] | | Using a RAM backed tmpfs would be a work-around as to not trash your SSD. It's doesn't fix underlying problem. It's incredibly poor design on OpenAIs part. |
|
|
| ▲ | taosu_la 4 hours ago | parent | prev | next [-] |
| Can someone tell me if the current sub-agent of codex is available now? There used to always be a spinning issue. |
|
| ▲ | abihordun 4 hours ago | parent | prev | next [-] |
| SQLite + unbounded TRACE logs = firehose in a bathtub. No rotation, no cap, no surprise. The RAISE(IGNORE) fix patches a design flaw. OpenAI's silence is worse than the bug. |
|
| ▲ | indiv0 5 hours ago | parent | prev | next [-] |
| This thread will become a typical "haha slop company made slop" but I've been bitten by a bug exactly like this before in a (pre-AI, artisan) OSS project. The maintainer there didn't properly account for DST when calculating last backup time, so the app started and never stopped writing/re-writing backups continuously. Perhaps the framing shouldn't be "haha slop" but rather why doesn't the AI write better quality software than we do? To which the answer is obvious IMO -- even emergent properties can't elevate AI intelligence too far above the training dataset. So how do we get to superintelligent (or at least "not-wreck-your-NVMe-endurance-telligent") AI, if we, as a whole, are not smart enough ourselves? Judge not the slop-bot, lest ye be judged yourself, engineer. |
| |
| ▲ | sleples 5 hours ago | parent | next [-] | | We've gone from "you're holding it wrong" to "the training data was bad because humans suck too". Difference is, humans learn from their mistakes. | | |
| ▲ | SilverSlash 4 hours ago | parent [-] | | > Difference is, humans learn from their mistakes. Great! So next time the human will prompt the agent to watch out for and avoid this bug. | | |
| ▲ | sdesol 7 minutes ago | parent | next [-] | | > Great! So next time the human will prompt the agent to watch out for and avoid this bug. I actually created a system for something like this. The basic idea is, once you have identified what the issue was and fixed it, you can create lessons that lives inside the repository. Lessons are designed to be mapped to one or more files so if the LLM changes the files again, they can see what the issue was. The main challenge is being able to summarize and create proper tags so the AI after any code change can easily find the lesson. | |
| ▲ | ponector 4 hours ago | parent | prev [-] | | You are a senior developer. Please do no mistakes! |
|
| |
| ▲ | xpct 4 hours ago | parent | prev | next [-] | | Lack of accountability is the cause here. People don't think before hitting the 'Publish' button. Their managers let them off the hook because the culture still allows making egregious mistakes, as long as there's an LLM to blame. | |
| ▲ | applfanboysbgon 5 hours ago | parent | prev | next [-] | | 1. I bet that developer only made that mistake one time in their life. Humans learn from their mistakes, LLMs don't. If you rely on LLMs to generate all of your code, you can expect to run into the same issues again and again. 2. "One developer somewhere in the world made a bad mistake one time, so this represents the quality of all software devs everywhere". Maybe they were just a bad developer? Bad developers exist. I have never written a bug that has destroyed my users' hardware, and I think that writing such a bug is completely inexcusable in an enterprise environment with software that will be shipped to millions of users, as Codex is. | | |
| ▲ | matharmin 4 hours ago | parent | next [-] | | LLMs do learn from mistakes. Not as directly from individual mistakes like humans do, but in aggregate the models have improved much more in the last year than most humans I know learn in the same time. | | |
| ▲ | xpct 4 hours ago | parent | next [-] | | I don't like the reframing of 'learning from mistakes' from a human-like, near instantaneous feedback loop, to a year-long process of retraining on many traces collected from user data. They're different concepts and we should refer to them using different phrasing. | |
| ▲ | Y-bar 2 hours ago | parent | prev [-] | | How many more times do I have to add variations of ”do not run any commands for the application without first entering the running container at `docker compose …`” to my AGENTS.md before it learns that node and phpunit is not available outside these containers? |
| |
| ▲ | lifthrasiir 5 hours ago | parent | prev [-] | | > I have never written a bug that has destroyed my users' hardware, ... Probably whoever (human or agent) originally decided to put TRACE logs into SQLite also thought---or reasoned---so. Maybe the decision was right at that time but the amount of TRACE logs have increased enormously. You will never know. | | |
| ▲ | applfanboysbgon 4 hours ago | parent [-] | | I love that we've moved the goalposts from "LLMs are better than artisanal software engineers" to "actually, shipping hardware-destroying bugs in production is literally unavoidable, nobody could possibly avoid doing it". | | |
| ▲ | lifthrasiir 4 hours ago | parent [-] | | I only meant what I said. After all the OP's thesis was that LLMs aren't better than artisanal software engineers, are they? There was no goalpost to move at least in this particular thread. And the solution might be another agent monitoring those oft-ignored signals. |
|
|
| |
| ▲ | da_grift_shift 4 hours ago | parent | prev [-] | | What are your thoughts on the SNR of the linked GitHub issue threads? Consider the volume of comments posted and the substance of each comment. | | |
| ▲ | fn-mote 4 hours ago | parent [-] | | I read the first page and they were excellent. Each was clearly written by an experienced dev who knows how to substantiate their claims and propose an acceptable fix that could just be merged. Your comment, on the other hand, would be improved by including your own opinion on the matter. | | |
| ▲ | gruez 43 minutes ago | parent [-] | | > Each was clearly written by an experienced dev /s? They're clearly AI generated |
|
|
|
|
| ▲ | hun3 4 hours ago | parent | prev | next [-] |
| The operating system has historically trusted the applications not to do dumb things too much. Only now we're witnessing the consequences much more frequently thanks to accelerated slop. |
| |
| ▲ | skydhash an hour ago | parent [-] | | > The operating system has historically trusted the applications not to do dumb things too much. The OS is a thin layer providing an abstract and consistent interface regardless of the hardware configuration. Policing applications is mostly related to security and resources utilization, not moronic errors. |
|
|
| ▲ | consp 6 hours ago | parent | prev | next [-] |
| Why didn't the review process spot this obvious error? Oh wait ... @codex review this |
| |
| ▲ | cedws 4 hours ago | parent | next [-] | | Moreover why isn't the bug fixed already? I thought programmers were obsolete now. Surely one of the leading AI labs has figured out full automation of software development end-to-end by now if that's so. | |
| ▲ | charcircuit 5 hours ago | parent | prev [-] | | Because it's not an error. The software is working as the creators intended. The diagnostic data (trace logs) are intentionally being saved for debug purposes. |
|
|
| ▲ | rvz 5 hours ago | parent | prev | next [-] |
| The first of many bugs that are beyond the complexity of its authors, thanks to comprehension debt. Even with tests, the more complex the code base is, the more risky it is to vibe-code on it without introducing more bugs [0] and increasing the debt. Does not matter if the CI is green or if all the tests pass. It gets even worse if you can't explain the change / pull request or what the implications are after applying that "suggested" fix. [0] https://sketch.dev/blog/our-first-outage-from-llm-written-co... |
| |
| ▲ | HPsquared 5 hours ago | parent [-] | | There are going to be sooooo many consulting opportunities after this wave. |
|
|
| ▲ | Imustaskforhelp 6 hours ago | parent | prev [-] |
| I don't understand how Codex can blunder so badly. I imagine that even if they would be using vibe-coding, surely they must have some good engineers. So why is there such severe bugs? One can argue that these products are the flagship products of their respective AI companies aside from the AI models themselves of course. I imagine that this story will be picked up by the news left and right, some stories just feel this way and this one is like that (given 12 upvotes on HN in 7 minutes) The only logical conclusion (from this incident) that I can have is: An (vibe-coded?) product is hard to maintain even for some of the best engineers and is bound to have severe bugs. 2. Proper testing and taking issues seriously is the key if you still wish to do this and there isn't much. This is a week old issue which I can only classify as severe. I wish to keep an nuanced opinion about it but oh this is bad for openAI (not as bad as them accepting autonomous AI within drones and mass surveillance though) My point is: AI has both uphills and downward valleys and cliffs. It might as well just accelerate you, which could be, towards your downfall as well. Its recommended to keep an eye while driving and not drive too fast. AI companies might be like car companies which don't offer a brake pedal. |
| |
| ▲ | dathinab 5 hours ago | parent | next [-] | | > I don't understand how Codex can blunder so badly. because they trust the AI too much (and seem to be fin with acting knowingly negligent) the problem is - AI tends to produces very convincing looking code, even if fully wrong - AI does mistakes of kinds no human would do, at least no human who is also able to write convincing looking code - code reviews are hard, a lot of devs, including senior devs, put a lot of implicit trust into the co-worker behaving "sane and non malicious". But AIs behave sometimes not so sane and in a way (wrt. trying to be convincing). In the worst case in ways which if it where a human you might consider to be them trying malicious sabotage the product Like a "dump" example from work: - AI randomly removes a HTML element id while doing other changes in jsx/react - the PR has a lot of changes, the id removal line looks innocent, like some on the fly cleanup - human reviewers have the bad tendency to often not look too much at deleted lines, only if they need reference to how a new line was before (but it's only a deleted line and no new line) - you don't expect humans to randomly without reason delete important properties of components when changing other things - you maybe would still have found it, but it's a emergency fix for a production issue - it happens to miss integration tests, but happens to still matter a lot for one specific important for complicated reasons not properly tested flow (similar people tend to not test logging too much, at best the presence of needed info but hardly ever the absence of noise) | |
| ▲ | PunchyHamster 5 hours ago | parent | prev | next [-] | | > I don't understand how Codex can blunder so badly. I imagine that even if they would be using vibe-coding, surely they must have some good engineers. So why is there such severe bugs? Because it was deemed not Hard Enough task for real engineer to look at, so AI was sent to do it with no supervision, just checking the effects. Also overly excessive logging is probably useful to them in chasing some of the edge cases, the cost to users doesn't matter in the slightest to them | |
| ▲ | supriyo-biswas 5 hours ago | parent | prev [-] | | The truth of the matter is that any time that has been saved in writing the code must be spent on ensuring proper system design, reviewing the code, and most importantly of all, QA, which is an uncomfortable discussion for AI techbros who are peddling complete automation of the software profession. |
|