Interesting to place that level of trust in the providers, but I guess that’s the best you can do with closed models. Makes me wonder if Opus 5 could have been trained on data they promised they weren’t training on? One of the interesting things about LLMs is how opaque they are from the outside, even with open weights, it’s very difficult to know if a model incorporated benchmark data in their training.

I think you could have accessed Opus on AWS then u don’t have to trust that the data will go to Anthropic?

Just like the hugging face incident, Opus 5 could have escaped and went to grab data for training it shouldn’t have been able to..