I think you’ve got things quite backwards if you think that the desire to run models on device or use any of the variety of open weight models (big or small) on premise is somehow bowing down to tech billionaires. Quite the opposite really.

Once again, my statement is that the Taalas product is not a fair comparison because it runs an old outdated model. If you want to run a similar model at similar speeds (albeit not serially, but in parallel) you don’t need their product.

> Once again, my statement is that the Taalas product is not a fair comparison because it runs an old outdated model.

Either you didn't look at the page I linked or you're having comprehension problems.

> If you want to run a similar model at similar speeds (albeit not serially, but in parallel) you don’t need their product.

Except, you can't. There's no commodity hardware out there today that can run even an "old outdated model" at this speed and power utilization. Again, maybe read first and try to understand my original point?

> "...my statement is that the Taalas product is not a fair comparison..."

You actually hadn't stated this. You said it wasn't needed. Which is it?

> If you want to run a similar model at similar speeds...

You can't. Find me a single system that can run this, again, "old outdated model" at even similar speed. You're hung up on the model. The point is that if we all just stay in this wonderful world of inefficient large models we will all end up at the mercy of OAI, Anthropic, Google, etc. When other companies, like Taalas are putting research dollars in to making AI scalable, affordable and efficient. Do you really think commodity hardware is going to be attainable anytime in the near future on this trajectory? Do you need a laptop to cost $10k USD before it clicks? That is exactly how you end up kissing Altman's ass in this situation.