Remix.run Logo
Ekaros an hour ago

I keep being amazed how most basic things are not checked. Cross-tenant isolation is one of the main things I check for... With other generic information leaks.

pc86 an hour ago | parent [-]

Sturgeon's Law is proved correct time and again. Most things are crap. Most people produce some crap in their lives. Some people only produce crap. Those people still need to eat but unfortunately some of them (somehow) find their way into tech and actually convince people to pay money for crap.

Especially with a low bar to entry like what is essentially AI-backed transcription-as-a-service, I'm not sure 90% is high enough. There will be 100 companies offering essentially the same thing and it's unfortunately the responsibility of the customer to find the one written by someone who doesn't have a parsnip where their brain should be.

noir_lord an hour ago | parent [-]

Fortunately we have LLM's to not produce that crap... wait, those LLM's were trained on the existing crap and produce the same crap... oh no.

user43928 43 minutes ago | parent | next [-]

I doubt SOTA models nowadays are going to produce an implementation without any kind of authentication like here, and not tell you about it.

And even if, a later "is this ready for release" will probably surface such obvious issues.

I do not think LLMs are the problem here. Today, they are most likely more competent than whoever set this up.

wongarsu 15 minutes ago | parent | next [-]

However if you start current SOTA models out on a bad codebase they will happily write more bad code to fit in with the "conventions" of the existing code. Including authentication and isolation. If you start out your app on the wrong foot (for example because you lack the vocabulary to express what you need) you can end up with nicely polished turds

Asking the LLM for a review of the code would still have caught it

skydhash 27 minutes ago | parent | prev [-]

Still the six month wait time when everything should be good? /s

bonoboTP 7 minutes ago | parent | prev [-]

They were RL trained on verifiable rewards. It's not purely learning to predict the next token of a human produced stream.