Model interpretability is going to be the final frontier of software. You used to need to debug the code. Now you'll need to debug the AI.

With the number of operations and the error rate in GPUs this is going to be interesting in SOTA models.