| ▲ | augment_me 5 hours ago |
| The repo has fp16 numbers. Also this one for 4070s shows that its for fp8 as well: https://github.com/JustAResearcher/gpu-unlock-ada/releases/t... |
|
| ▲ | Tuna-Fish 3 hours ago | parent [-] |
| it's the widening (for example: fp16 * fp16 = fp32) instructions, which are useful on some loads. |
| |
| ▲ | augment_me an hour ago | parent | next [-] | | I assumed the comment above is referring to operand dtype and not accumulator dtype since they mentioned ops. In general even for nvfp4 you use fp32 accumulators because you are usually reducing over large Ks which mean large values. | |
| ▲ | an hour ago | parent | prev [-] | | [deleted] |
|
