If you never backed up the keys, any failure of the hardware/software results in loss of everything. Maybe you'd buy multiple of them and copy the keys over.

You trust diceware because you can trust the dice to give random numbers, and the whole process is visible before you. Even with a non-malicious wallet, you have to trust that they competently implemented the random generator and no bugs have crept in over hardware/software revisions.