Remix clone Hacker News

new | show | ask | jobs Github

▲

OtherShrezzing 5 hours ago

While that might be true, for as long as its name is “.cpp”, people are going to think it’s a C++ library and avoid it.

▲

eterm 5 hours ago | parent | next [-]

This is the first I'm learning that it isn't just a C++ library.

In fact the first line of the wikipedia article is:

> llama.cpp is an open source software library

	▲	4 hours ago \| parent [-]
		[deleted]

▲

RobotToaster 5 hours ago | parent | prev | next [-]

It would make sense to just make the GUI a separate project, they could call it llama.gui.

▲

homarp 3 hours ago | parent [-]

it is called llama-barn https://github.com/ggml-org/LlamaBarn

	▲	adrian_b an hour ago \| parent [-]
		LlamaBarn is the MacOS app, not the HTTP API server, which is "llama-server". On non-Apple PCs, "llama-server" is what you use, and you can connect to it either with a browser or with an application compatible with the OpenAI API. Perhaps using "llama-server" as the name of the project would have been less confusing for newbies than "llama.cpp". I confess that when I first heard about "llama.cpp" I also thought that it is just a library and that I have to write my own program in order to implement a complete LLM inference backend.

▲

figassis 5 hours ago | parent | prev [-]

This is correct, and I avoided it for this reason, did not have the bandwidth to get into any cpp rabbit hole so just used whatever seemed to abstract it away.