Remix.run Logo
▲ superkuh 5 hours ago

Uh, no. This headline is wrong. It's FP32 unlocked from being halved, not 16 bit ops. And to be clear, over the last week I've looked many places and I've not seen any reports of this unlock being applied to any 3xxx card except the 3090/3090ti series. Even if it might apply more generally in theory.

▲Zagitta 4 hours ago | parent | next [-]

It's the FP/BF16 FMA to FP32 instructions.

And also it does work on most 3000 series cards as they all run the same GA102 booter that's vulnerable :-) There are some reports of cards with weird vbios layouts having issues but i'll try to get that fixed

▲augment_me 5 hours ago | parent | prev | next [-]

The repo has fp16 numbers.

Also this one for 4070s shows that its for fp8 as well:

https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...

▲Tuna-Fish 3 hours ago | parent [-]

it's the widening (for example: fp16 * fp16 = fp32) instructions, which are useful on some loads.

▲augment_me an hour ago | parent | next [-]

I assumed the comment above is referring to operand dtype and not accumulator dtype since they mentioned ops. In general even for nvfp4 you use fp32 accumulators because you are usually reducing over large Ks which mean large values.

▲ an hour ago | parent | prev [-]
[deleted]
▲Tiberium 5 hours ago | parent | prev [-]

The repo has a lot of reports of people applying it to other 3xxx card, see https://github.com/Zagitta/gpu-unlock/issues

There's at least 3080 Ti, 3070 Ti, 3070, 3060

▲RachelF an hour ago | parent [-]

There's also a Windows version:

https://github.com/impacifist/Windows-GPU-UNLOCK