Remix.run Logo
heaney-555 8 hours ago

Latency and compute comparison needed.

thephyber 8 hours ago | parent [-]

Is benchmarking Jev still a ToS violation?

ricardobeat 8 hours ago | parent [-]

Was it? That would make it unusable in any corporate setting.

thephyber 6 hours ago | parent [-]

I heard it was and just repeated what I heard.

A Google AI prompt says

> TypeSafe AI's Master Customer Agreement explicitly prohibits using the services or model outputs to develop a competing product, perform model distillation, or reverse engineer the service, which generally restricts competitive benchmarking aimed at replicating the model.

It doesn't explicitly prohibit benchmarking by name, but the previous terms (which seem aimed at preventing Jev being used to increase the value of competitive products) does seem to lean that direction.

That said, MsSQL had terms which prevented publishing benchmarks which compared it against other SQL DBs and that wasn't enough to prevent some companies from using it.

Why anyone would want to work for a company who thought so little of their own product that it couldn't stand up to customers using it for normal business processes is beyond me.

the_duke 3 hours ago | parent [-]

Oracle also famously forbids posting public benchmarks of the DB.