| ▲ | altruios 3 hours ago | |
what tokens/s are you getting with a 122B MoE model in this setup? I didn't see any benchmarks in the benchmarks section on the readme.md | ||
| ▲ | aegis_camera an hour ago | parent | next [-] | |
https://www.sharpai.org/benchmark/ The MLX part is what we've done with SwiftLM, the local result is still being verified more details are on-going. | ||
| ▲ | aegis_camera 2 hours ago | parent | prev | next [-] | |
I'll add more details. We just wired up the pipeline on both MAC and IOS. | ||
| ▲ | gigatexal 2 hours ago | parent | prev [-] | |
yeah this I'd like to see added to teh readme. | ||