Remix.run Logo
salawat 18 hours ago

There's no fucking training to mitigate a slot machine.

subscribed an hour ago | parent | next [-]

LOL, that's a sophisticated and sometimes slightly unpredictable multitool.

If this is the "analogy" you go for, you don't seem to be suited to make that comparison.

LPisGood 4 hours ago | parent | prev | next [-]

There’s actually been a ton of research on how to optimize “slot machines,” at least in a generalized sense. For more reading, check out the literature on multi armed bandits.

serf 4 hours ago | parent | prev | next [-]

that analogy is so boring now with so many real world examples of actual LLM work.

people still can't get over the unreasonable effectiveness of algorithms.

arkadiytehgraet 32 minutes ago | parent | next [-]

There have also been winners of a slot machine gamba, so the analogy quite holds. I would even argue that there are considerably more slot machine gamba winners than the real world examples of actual LLM work.

greenchair 2 hours ago | parent | prev [-]

nondeterminism will always be anathema to the engineering mind

dgellow 6 hours ago | parent | prev [-]

Games like Diablo are basically a whole bunch of slot machines, and there are strategies you can follow to optimize your run.

gambiting 5 hours ago | parent [-]

Yes, because in video games there is always a chance to win so you can optimize your strategy around that chance. If you have a 1% chance to drop a legendary weapon, the question becomes how do I manufacture 100 chances for a weapon drop in the shortest possible time. With agentic coding there is no such guaranteed chance - in a way it's worse than a slot machine that is guaranteed to pay out eventually. You could spend hundreds of millions of tokens and still not get what you asked for.

dgellow 32 minutes ago | parent | next [-]

You’re right, the arpg analogy isnt great, it’s too simplistic. I was trying to come up with something heavily stochastic where people are coming up with strategies to get the odds in their favor. Maybe closer to speculating on the real estate market? But even that feels too simplistic compared to LLMs. Even the definition of a win isn’t well defined.

Actually it’s really its own thing, I don’t think the slot machine analogy works too well, you also have fixed odds (and you know they aren’t in your favor), and a binary output

echoangle 4 hours ago | parent | prev [-]

> If you have a 1% chance to drop a legendary weapon, the question becomes how do I manufacture 100 chances for a weapon drop in the shortest possible time.

Sidenote but I hope everyone realizes that 100 is kind of arbitrary here and does not mean the total chance to to get something is 100%.

avadodin 2 hours ago | parent [-]

you don't have to do the math unless it's on the exam, lol.