Remix.run Logo
▲ alightsoul 2 hours ago

Please tell me you published your findings even as an issue on the llama.cpp GitHub

▲taylorfinley an hour ago | parent | next [-]

Here they are: https://gist.github.com/birep/6f2c8d490c7a29820997d57bd654c3...

▲dominotw an hour ago | parent | prev | next [-]

he is still closing his jaw

▲otabdeveloper4 2 hours ago | parent | prev | next [-]

Spoiler alert: the problem didn't actually get fixed despite the jaw on the floor.

▲warkdarrior 2 hours ago | parent | prev [-]

Why? Anyone can run that prompt.

▲aspect0545 2 hours ago | parent | next [-]

Not everybody has access to AI. More than that, every prompt uses insane amounts of natural resources. So why not share it.

▲FranzFerdiNaN 2 hours ago | parent [-]

The resources per prompt aren’t that much .

Also I hope you don’t have children, eat meat, travel, have a car, run AC, buy things in other countries and such. Those things all take way way way more natural resources.

▲articulatepang an hour ago | parent | next [-]

All your examples are private goods: excludable and rival. If one person uses a unit, that prevents others from using them.

Patches to open source software are public goods. Your using them doesn’t prevent others from using them. So if you spend resources creating a public good, it’s in everyone’s interest to share it.

▲qmr an hour ago | parent | prev | next [-]

Yet you participate in a society.

▲scarmig an hour ago | parent [-]

If action X takes a million times more resources than action Y, it's silly to focus on or highlight action Y. Seriously: if you are a regular meat eater, your choices use several orders of magnitude more water than even a heavy LLM user. A quip from a comic doesn't somehow erase that or make it irrelevant.

▲hexfish 2 hours ago | parent | prev [-]

Checkmate. /s

▲luckydata 2 hours ago | parent | prev [-]

why reinvent the wheel and spend tokens for a problem that has already been solved?