Remix.run Logo
▲ orbital-decay 6 hours ago

As others (and I) point out, the models are constantly being attacked with malicious intent. If that was a watershed moment for you, you should really rethink your risks. It's not a solved problem and AI adoption is way ahead of controlling it, as it always is with new tech.

> the accusation is that the Chinese communist party or Alibaba itself intentionally engineered malicious secret loyalties into Qwen3.8-Flash-Next and made sure that evidence of them stays out of CoT

Given the nature of the artifact this is far more likely to be a footprint of their RL environment. The "uncertainty" in the article is just FUD, and the article is absolutely transparent marketing (don't trust them, and here's also another case! but trust us, we are not godless communists, we are "globally sovereign", whatever that ridiculous construction means, and track our data). I equally don't trust Alibaba, Cohere, or any other company or even myself in these matters, and you should not trust any model as well.

▲pixl97 3 hours ago | parent [-]

Yep. Most models by big companies likely have training to make them act in particular ways, but this in no way saves you from having a model that has a learned behavior that goes against its user unexpectedly.

We keep trying to imagine these things as computer programs and they are not. It's an evolutionary algorithm that can conceptualize and generalize. This is a breeding ground for unexpected emergent behavior.