Remix.run Logo
measurablefunc 6 hours ago

I guess the next step would be adding support for quantized arithmetic.

godelski 2 hours ago | parent | next [-]

FYI float is already quantized. It isn't continuous nor infinite. Even the distribution of representable numbers isn't uniform (more dense in [-1,1]).

measurablefunc 2 hours ago | parent [-]

The standard definition of quantized arithmetic for neural networks is not the same as the one used for floating point or double floating point values in the IEEE standardization of "real" arithmetic: https://arxiv.org/abs/1712.05877

pstoll 6 hours ago | parent | prev [-]

And the lower precision float variants.