▲ | deepdarkforest 4 days ago | |
No worries. GGUF is more suitable for the latest open-source models, i agree there. Quant2/Q4 will probably be critical as well, if we don't see a jump in ram. But then again I wonder when/If mediapipe will support GGUF as well. PS, I see you are in the latest YC batch? (below you mentioned BF). Good luck and have fun! |