| ▲ | simonw 2 hours ago | ||||||||||||||||
The models themselves are showing up on Hugging Face here: https://huggingface.co/prism-ml/models I've tried a couple in LM Studio - the GGUF one and the MLX one - but neither worked there. Anyone else get them to work? Might be that LM Studio needs to upgrade their llama.cpp or MLX engines first. | |||||||||||||||||
| ▲ | bansaltushar an hour ago | parent | next [-] | ||||||||||||||||
Depending on which model you're running, you might need to use the custom forks. Details are here -> https://github.com/PrismML-Eng/Bonsai-demo/blob/main/README.... | |||||||||||||||||
| |||||||||||||||||
| ▲ | trollbridge an hour ago | parent | prev [-] | ||||||||||||||||
Didn't work for me in Unsloth, but it will probably be fixed in a day or two when the next batch of updates comes out. | |||||||||||||||||