Remix.run Logo
nine_k 4 hours ago

In this regard, the release of open-weight Gemma models that can run on reasonable local hardware, and are not drastically worse than Anthropic flagships, is quite a punch. An M2 Mac Mini with 32GB is about 10 months worth of Claude Max subscription.

Readerium 3 hours ago | parent [-]

In coding they are worse.

Chinese models (GLM, MiniMax) are better.

nine_k 3 hours ago | parent [-]

Anyway, there are a few model that are freely distributable, and that can reasonably run on consumer-grade local hardware.

It changes a number of things. Not all tasks require very high intelligence, but a lot of data may be sensitive enough to avoid sharing it with a third party.