Is there no git trick to turn off version control on non-text files but still store them? How does Lore handle them better?

You still want version control, and locking so that two artists don't concurrently edit the same asset.