I wonder if this is going to create more market demand for truly open source models, where everything including the dataset is inspectable. It definitely seems like good news for companies like Mistral that want you to build on their models but they're not close to the frontier.

The paper's abstract itself says that behavior can be encrypted such that it remains opaque even with full access to model weights.