| ▲ | vforno 7 hours ago | |||||||||||||||||||||||||||||||
In the readme you can see benchmark which everyone with different hardware is running Colibrì, and I have to say I've seen great times! I'm always doing more to improve! | ||||||||||||||||||||||||||||||||
| ▲ | walrus01 7 hours ago | parent [-] | |||||||||||||||||||||||||||||||
I have a 16-core system with 256GB RAM here I could try it with but regretfully it's so old the CPUs aren't AVX2 capable. Otherwise it makes a fairly good llama-server test system for CPU only stuff. Oh well. Time to upgrade (painful to the wallet these days). | ||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||