| ▲ | mirekrusin an hour ago | |
Great to see Meta back, looks like really strong, local model, can't wait for llama.cpp support. | ||
| ▲ | jakswa 22 minutes ago | parent [-] | |
some support already merged, and I verified in a local build that it runs (cannot get MTP params working tho, about ~40 tok/s on my beefy 800GB/s 7900XT w/ 20GB VRAM). https://github.com/ggml-org/llama.cpp/pull/26841 | ||