| ▲ | quicklywilliam a day ago | |
This smells off. | ||
| ▲ | SillyUsername a day ago | parent [-] | |
So did Strata Vs Llama.cpp, yet Strata pulls 2.5 to 3x the performance of the Llama.cpp codebase it was based on. If they've improved the architecture further by sharing experts, then this might be plausible. | ||