Remix.run Logo
tosh 4 hours ago

This is a bit like saying stop using Ubuntu, use Debian instead.

Both llama.cpp and ollama are great and focused on different things and yet complement each other (both can be true at the same time!)

Ollama has great ux and also supports inference via mlx, which has better performance on apple silicon than llama.cpp

I'm using llama.cpp, ollama, lm studio, mlx etc etc depending on what is most convenient for me at the time to get done what I want to get done (e.g. a specific model config to run, mcp, just try a prompt quickly, …)

oefrha 4 hours ago | parent | next [-]

> Both llama.cpp and ollama are great and focused on different things and yet complement each other

According to the article, ollama is not great (that’s an understatement), focused on making money for the company, stealing clout and nothing else, and hardly complements llama.cpp at all since not long after the initial launch. All of these are backed by evidence.

You may disagree, but then you need to refute OP’s points, not try to handwave them away with a BS analogy that’s nothing like the original.

matja 4 hours ago | parent | prev | next [-]

> This is a bit like saying stop using Ubuntu, use Debian instead.

Not really, because Ubuntu has always acknowledged Debian and explicitly documented the dependency:

> Debian is the rock on which Ubuntu is built.

> Ubuntu builds on the Debian architecture and infrastructure and collaborates widely with Debian developers, but there are important differences. Ubuntu has a distinctive user interface, a separate developer community (though many developers participate in both projects) and a different release process.

Source: https://ubuntu.com/community/docs/governance/debian

Ollama never has for llama.cpp. That's all that's being asked for, a credit.

UqWBcuFx6NV4r 4 hours ago | parent [-]

OK. That says absolutely nothing about actual UX or anything that matters to most actual users (as opposed to argumentative HN ideologues).

operatingthetan 4 hours ago | parent | prev | next [-]

I guess read the article before commenting?

carlostkd 3 hours ago | parent | prev | next [-]

There isn't much you can do with Ollama models besides saying good morning.

damnitbuilds 4 hours ago | parent | prev [-]

The author points out that the Ollama people are evil.

So it is more like saying "Stop using SCO Unix, use Linux instead".

yuppiepuppie 4 hours ago | parent [-]

Where do they use the term "evil"?

cadamsdotcom 4 hours ago | parent | next [-]

In the gaps between the tops of the lines and the bottoms of the other lines ;)

damnitbuilds 3 hours ago | parent | prev [-]

They might not use the word, but the behavior they describe is evil:

" This isn’t a matter of open-source etiquette, the MIT license has exactly one major requirement: include the copyright notice. Ollama didn’t.

The community noticed. GitHub issue #3185 was opened in early 2024 requesting license compliance. It went over 400 days without a response from maintainers. When issue #3697 was opened in April 2024 specifically requesting llama.cpp acknowledgment, community PR #3700 followed within hours. Ollama’s co-founder Michael Chiang eventually added a single line to the bottom of the README: “llama.cpp project founded by Georgi Gerganov.” "