| ▲ | swyx 2 hours ago | |
jev ceo on why he eschewed benchmarking: https://www.latent.space/i/216783460/privacy-benchmarking-an... | ||
| ▲ | arbot360 25 minutes ago | parent | next [-] | |
Many SaaS vendors forbid benchmarking, I find it crazy that such anti-competitive terms are standard across the industry but they are. Generally the goal of such terms is to "control the narrative" around the product, regardless of the truth of performance being better or worse than competitors. | ||
| ▲ | tomrod 6 minutes ago | parent | prev | next [-] | |
I mean, that's a great reason to ignore JEV entirely. "Trust, but verify" isn't just a catchy cliche. It's the only way to operate where models and code are fast to market. | ||
| ▲ | jldugger an hour ago | parent | prev [-] | |
Interesting; was curious how this didn't fall into trouble with ToS. Apparently the "no benchmarks" clause was intended for "limited preview" audiences and didn't get removed at launch on accident. | ||