> is responsible for a good portion of software crashes

I doubt it's the case, it should result in slightly different logits and generated tokens, but it shouldn't lead to crashes.

I suspect what you're facing are simply driver bugs…

It's memory/tiling alignment issues + wrong instruction/feaatures.