| ▲ | Archit3ch 5 hours ago | |
Working on something similar targeting macOS on Apple Silicon, Unsloth split GGUF, compressed partial residency in unified memory (would make more sense on 128GB instead of my 64GB...), native Metal kernels, and RAM-only native compressed KV. Happy to put on GitHub when it's ready. | ||
| ▲ | xtracto 5 hours ago | parent | next [-] | |
I will be delighted to try. I have a 128gb macbookpro m4 waiting for this. | ||
| ▲ | sebastianconcpt 5 hours ago | parent | prev | next [-] | |
This is the way. | ||
| ▲ | fragmede 5 hours ago | parent | prev [-] | |
Followed you on GitHub to get notified when you are! | ||