Remix.run Logo
lmf4lol 6 hours ago

Interesting story. But despite Cursors or Railways failure, the blame is entirely on the author. They decided to run agents. They didnt check how Railway works. They relied on frontier tech to ship faster becsuse YOLO.

I really feel sorry for them, I do. But the whole tone of the post is: Cursor screwed it up, Railway screwed it up, their CEO doesnt respond etc etc.

Its on you guys!

My learning: Live on the cutting edge? Be prepared to fall off!

shiandow 35 minutes ago | parent | next [-]

For a company that puts DO NOT FUCKING GUESS in their instructions they made a heck of a lot of assumptions

- assume tokens are scoped (despite this apparently not even being an existing feature?)

- assume an LLM didn't have access

- assume an LLM wouldn't do something destructive given the power

- assume backups were stored somewhere else (to anyone reading, if you don't know where they are, you're making the same assumption)

Also you should never give LLMs instructions that rely on metacognition. You can tell them not to guess but they have no internal monologue, they cannot know anything. They also cannot plan to do something destructive so telling then to ask first is pointless. A text completion will only have the information that they are writing something destructive afterwards.

arcticfox 4 hours ago | parent | prev | next [-]

There was practically no responsibility taken by the author, all blame on others. It was kind of shocking to read.

Anyone using these tools should absolutely know these risks and either accept or reject them. If they aren't competent or experienced enough to know the risks, that's on them too.

throwaway041207 4 hours ago | parent | next [-]

And it doesn't even have to do with these tools in the end, this is a disaster recovery issue at its root. If you are a revenue generating business and using any provider other than AWS or GCP and you don't have an off prem/multi-cloud replica/daily backup of your database and object store, you should be working on that yesterday. Even if you are on one of the major cloud providers and trust regional availability, you should still have that unless it's just cost-prohibitive because of the size of the data.

pixl97 3 hours ago | parent [-]

Like, shouldn't they teach the 3 2 1 rule of backups in school by now?

gigatree 3 hours ago | parent | prev [-]

The point of the post was to warn other people building with agents, especially using Cursor or Railway, not a public reflection

dymk an hour ago | parent | next [-]

It was also to put Cursor and Railway on blast and complain about how they should have safeguarded him from putting a gun to his database and pulling the trigger.

simonjgreen 2 hours ago | parent | prev [-]

Perhaps they should include a warning about learning systems design and architecture too then? It’s very incomplete.

manas96 4 hours ago | parent | prev | next [-]

200% agree. If you decide to use this power you must accept the tiny risk and huge consequences of it going wrong. The article seems like it was written by AI, and quoting the agent's "confession" as some sort of gotcha just demonstrates the author does not really understand how it works...

computerdork 3 hours ago | parent | prev | next [-]

I don’t know, software systems complicated, it’s pretty much impossible for one person to know every line of code and every system (especially the CEO or CTO). Yeah, it was probably one or two employees set this all up realizing the possibility of bad Cursor and Railway interactions.

if you’re a software dev/engineer, if you haven’t made a mistake like this (maybe not at this scale though), you’ve probably haven’t been given enough responsibility, or are just incredibly lucky.

… although, agreed, they were on the cutting edge, which is more risky and not the best decision.

kokada 2 hours ago | parent [-]

There is a difference between making a mistake like this one and being humble (e.g., lessons learned, having a daily external backup of the database somewhere else, or maybe asking the agent to not run commands directly in production but write a script to be reviewed later, or anything similar) and just blaming the AI and the service provider and never admitting your mistake like this article is all about.

The fact that this seems to be written by AI makes it even more ironic.

meisel 6 hours ago | parent | prev | next [-]

Yeah the author really should’ve taken some responsibility here. It’s true that the services they used have issues, but there’s plenty of blame to direct to themself

annoyingcyclist 2 hours ago | parent | prev | next [-]

I kept reading and reading to find the part where the author took responsibility for any part of this, then I got to the end.

sombragris 38 minutes ago | parent | prev | next [-]

The whole use of AI agents in this context reminds me of the movie "War Games"

  > A strange game.
  > The only winning move is
  > not to play.
reliablereason 3 hours ago | parent | prev | next [-]

Right! Blaming an agent or anyone else is crazy. The author built a system that had the capability of deleing the prod database.

The system did delete the database cause the author built it like that.

nzoschke 3 hours ago | parent | prev | next [-]

And they decided to leave a token with destructive capabilities in the agents access, and decided to not have verified backups for their database.

My team practices "no blame" retros, that blame the tools and processes, not the individuals.

But the retro and remediations on this are all things the author needs to own, not Railway or Cursor.

- Revoke API tokens with excessive access

- Implement validated backup and restore procedures

- ...

angrydev an hour ago | parent | prev | next [-]

I love boring tech. It's reliable as hell and not as full of hidden surprises. Screw the cutting edge for serious work.

Zopieux 4 hours ago | parent | prev | next [-]

It's hilarious how much they can't take any accountability for running a random text generator in prod, and they could not even be bothered to write their own tweet.

I do not feel sorry, but I do feel some real schadenfreude.

6 hours ago | parent | prev | next [-]
[deleted]
estetlinus 4 hours ago | parent | prev [-]

100%

Trying to run a blame game is such a facepalm.