Remix.run Logo
tyleo 7 hours ago

We’re at a small startup and we mix models. But mainly just between the major providers. I wouldn’t say it’s as much to avoid spending money as it is to get the maximum benefit out of different capability spectrums.

6stringmerc 6 hours ago | parent [-]

Well, you can say that all day long but realistically would your “small startup” even exist if your firm was charged Enterprise rates or the actual compute costs and denied access to capital to subsidize your users? It’s a fair question.

The other, more complex one would be “what benefit” are you talking about? Clearly there are some differences in performance regarding speed and token cost, but industry news indicates not a single one has solved the inherent hallucination problem which makes the reliability akin to an untreated schizophrenic research or coding assistant.

notfromhere 6 hours ago | parent | next [-]

Hallucinations are not really a big problem in day to day work

VCFundedGenYer 4 hours ago | parent | next [-]

As a sysadmin I disagree mightily. LLMs are very bad at IT troubleshooting, server stuff, etc. Especially microsoft and powershell.

literalAardvark 3 hours ago | parent [-]

Yours might be. Sol is terrifying.

6 hours ago | parent | prev | next [-]
[deleted]
officialchicken 6 hours ago | parent | prev | next [-]

Are you the person paying for the hallucinations, or do you just like the free high?

notfromhere 5 hours ago | parent [-]

I’m the person implementing and monitoring output.

What high am I supposed to be getting? Please let me know so I can stop buying drugs

lazide 6 hours ago | parent | prev | next [-]

Depends on the work and the customer.

5 hours ago | parent | prev [-]
[deleted]
tyleo 5 hours ago | parent | prev [-]

The old, “it doesn’t matter because AI doesn’t work,” argument.

I thought we were past this.