| ▲ | anyfoo 16 hours ago | |
Yeah, analog memory fits so incredibly well. Who cares if it's not "exact" and fuzzes around a bit if it's only used for weights and has massive efficiency advantages. Weights are never "exact" themselves, and it doesn't matter if they don't always read exactly the same. You basically just get some extra "temperature" for free! A bit beautiful that we might end up partially going back to analog computers, which were quickly replaced by digital ones. | ||
| ▲ | magicalhippo 15 hours ago | parent [-] | |
> A bit beautiful that we might end up partially going back to analog computers, which were quickly replaced by digital ones. How long till we get a Ben Eater-style video about someone making a basic analog neural network using some DACs, analog multipliers[1] and bucket-brigade chips[2] for intermediate values? [1]: https://www.analog.com/media/en/training-seminars/tutorials/... | ||