Do you think there’s a call for introducing an even smaller float that can pack more values into a SIMD register? Like a 12 bit?

The latest GPUs and TPUs support fp8. It's a big part of the efficiency gain in the latest systems. Blackwell also supports fp4.