Just tried it on a medium size coding/debug problem on an existing codebase, observations: - Input doesn't look faster than other models, it spends a lot of time reading Read about 5M tokens - Output is awesome, super fast as you expect from the 1500t/sec I think that's correct - Tool call is failing more than say DS4, which leads to time wasted on retries (complex tools like browser control for example) - Shell commands are still somewhat of a bottleneck

The net effect is that I spend about the same time waiting, and I still need to read that output so, at least for coding, it actually reconciles me with the 100-200t/sec you can get on DS4 or the like. Maybe that's a good sweet spot after all and faster t/sec is not where the bottleneck is.

Also maybe my setup (OMP) doesn't do the cache correctly but that's a huge cost driver... so atm it's quite pricy

▲

peri-cl 6 hours ago | parent | next [-]

> "Also maybe my setup (OMP) doesn't do the cache correctly but that's a huge cost driver... so atm it's quite pricy"

I don't believe Cerebras has a cached input pricing? They don't list one on the model page:

https://inference-docs.cerebras.ai/models/qwen-3.8-27b

edit: See the sibling discussion,

https://news.ycombinator.com/item?id=49554520#49555094 ("Input tokens, whether served from the cache or processed fresh, are billed at the standard input token rate")

▲

hexa00 6 hours ago | parent | next [-]

lol yeah just saw that, yeah that makes it unusable I think at least for me.

I wonder if they will do that with sol ultrafast!

▲

olivermuty 6 hours ago | parent | prev [-]

They have cache, but it costs the same indeed, no idea what the point of the cache is

	▲	lostmsu 6 hours ago \| parent [-]
		They don't have cache (e.g. KV cache). But they write down what you sent earlier to say they cached it! To still bill the same as uncached later (because they didn't actually cache it)!

▲

irthomasthomas 5 hours ago | parent | prev | next [-]

I can't believe this situation has not improved in years. Is cerebras' main business selling the hardware, then?

	▲	tandema 8 minutes ago \| parent \| next [-]
		Cerebras is super constrained on capacity right now, all the support is going to enterprise customers.
	▲	redman25 5 hours ago \| parent \| prev [-]
		Maybe they’re gunning for speedy non-interactive pricing? Or its a limit of the technology or a business decision?

▲

nkhs89 6 hours ago | parent | prev [-]

[dead]