| ▲ | dgritsko an hour ago | |
This isn't quantized, right? Just a smaller context? | ||
| ▲ | DSingularity an hour ago | parent [-] | |
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized. | ||
| ▲ | dgritsko an hour ago | |
This isn't quantized, right? Just a smaller context? | ||
| ▲ | DSingularity an hour ago | parent [-] | |
Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized. | ||