| ▲ | bartdegoede 2 hours ago | |
It’s gets much larger (there’s the potion-multilingual-128M model, distilled from bge-m3 which has like 100 languages), so it gets to ~120m range for the lookup table (4x smaller if you’d do int8 quantization, so you could get to to 30-35mb). | ||