| ▲ | acuozzo 21 hours ago | |
Luke: Do you have benchmarks for BF16? | ||
| ▲ | lukebechtel 21 hours ago | parent [-] | |
Unfortunately, not at present; we went for FP8 because we believed it was generally the best tradeoff of quality and speed. Allowed faster iteration as well. We believe our improvements would hold on BF16, but let me check. | ||