What is the point of this, if it is p90 17 seconds? Might as well use an LLM. The beauty of Jev is that it is dirt cheap and insanely fast.

zihotki an hour ago | parent | next [-]

I would hold your horses to paint it as dirt cheap.. In my cases for spam detection Luna was 20% cheaper due to prompt caching, although not as fast.

	▲	atombender 16 minutes ago \| parent \| next [-]
		> hold your horses to paint it as dirt cheap For a moment I thought this was going to be a metaphor — maybe an ancient Chinese proverb about how paint brushes are made from horsehair and how you can't hold the horse to paint before you've turned the hair into a brush.
	▲	tyre 8 minutes ago \| parent \| prev \| next [-]
		What are the costs compared to an ML model?
	▲	olgava 27 minutes ago \| parent \| prev [-]
		[dead]

esafak an hour ago | parent | prev | next [-]

Jev ought to offer a flex mode that uses their spare capacity for a discount.

mabini an hour ago | parent | prev [-]

[dead]