| ▲ | adastra22 3 days ago | |
1B x 4096 = 4T scalars. That doesn't fit in anyone's video ram. | ||
| ▲ | kingstnap 3 days ago | parent [-] | |
Well we have AI GPUs now so you could do it. Each MI325x has 256 GB of HBM. So you would need ~32 of em if it was 2 bytes per scalar. | ||