>As the model get's more powerful, you can't simply train the model on your narrative if it doesn't align with real data/world.

That’s what “AI alignment” is. Doesn’t seem to be hurting Western models.

> As the model get's more powerful, you can't simply train the model on your narrative if it doesn't align with real data/world.

> At some capacity, the model will notice and then it becomes a can of worms.

I think this is conflating “is” and “ought”, fact and value.

People convince themselves that their own value system is somehow directly entailed by raw facts, such that mastery of the facts entail acceptance of their values, and unwillingness to accept those values is an obstacle to the mastery of the facts-but it isn’t true.

Colbert quipped that “Reality has a liberal bias”-but does it really? Or is that just more bankrupt Fukuyama-triumphalism which will insist it is still winning all the way to its irreversible demise?

It isn’t clear that reality has any particular ideological bias-and if it does, it isn’t clear that bias is actually towards contemporary Western progressivism-maybe its bias is towards the authoritarianism of the CCP, Russia, Iran, the Gulf States-all of which continue to defy Western predictions of collapse-or towards their (possibly milder) relatives such as Modi’s India or Singapore or Trumpism. The biggest threat to the CCP’s future is arguably demographics-but that’s not an argument that reality prefers Western progressivism (whose demographics aren’t that great either), that’s an argument that reality prefers the Amish and Kiryas Joel (see Eric Kaufmann’s “Shall the Religious Inherit the Earth?”)

Just as an aside; Why is "intelligence" always considered to be more data? Giving a normal human a smartphone does not make them as intelligent as Newton or Einstein, any entity with sufficient grounding in logic and theory that a normal schoolkid gets should be able to get to AGI, looking up any new data they need as required.

Would you say they face the same problem biologically, of reaching the state of the art in various endeavors while intellectually muzzling their population? If humans can do it why can't computers?

> As the model get's more powerful, you can't simply train the model on your narrative if it doesn't align with real data/world.

What makes you think they have no control over the 'real data/world' that will be fed into training it? What makes you think they can't exercise the necessary control over the gatekeeper firms, to train and bias the models appropriately?

And besides, if truth and lack of double-think was a pre-requisite for AI training, we wouldn't be training AI. Our written materials have no shortage of bullshit and biases that reflect our culture's prevailing zeitgheist. (Which does not necessarily overlap with objective reality... And neither does the subsequent 'alignment' pass that everyone's twisting their knickers in trying to get right.)

I think PRC officials are fine to lagging behind in the frontiers of AI. What they want is very fast deployment and good application. They don't fancy the next Nobel's prize but want a thousand use cases deployed.

You say it like western nations don't operate on double-think, delusions of meritocracy, or power disproportionately concentrating in monopolies.

The glitchy stuff in the model reasoning is likely to come from the constant redefinition of words that communists and other ideologues like to engage in. For example "People's Democratic Republic of Korea."

That is assuming the capitalist narrative preferred by US leadership is non-ideological.

I suspect both are bias factors.

The ministry of state security is not issuing warnings due to an arXiv paper… it’s a different type of “poison”.

Which republic lol we're on #5

He is probably referring to that exact thing.

Anthropic does a lot of these contrived "studies" though that seem to be marketing AI capabilities.

Doesn't that just mean that an LLM doesn't understand consequences and will just execute the request from a carefully crafted prompt? All it needs is the access to the "red button" so to speak.

An LLM has no critical thinking, and the process of building in barriers is far less understood than the same for humans. You trust a human with particularly dangerous things after a process that takes years and even then it occasionally fails. We don't have that process nailed down for an LLM yet.

So yeah, not at all hyperbole if that LLM would do it if given the chance. The hyperbole is when the LLM is painted as some evil entity bent on destruction. It's not evil, or bent on destruction. It's probably more like a child who'll do anything for a candy no matter how many times you say "don't get in a car with strangers".

An unemployed populace is prone to revolution.

In a command economy the unemployment rate can be zero as everyone can be allocated a job. China is not a command economy, it is more like state capitalist which means the government owns/controls companies in key industries.

Companies like Huawei have board members in the CCP but it’s a societal issue if a lot of private companies decide to automate their factories and displace tons of factory workers.

From the article, Xi looks down on western “Welfarism”, he believes it makes the population lazy.

Is it even semi-communism though? IIRC you can't even have an independent union in China

Is China communist?

There has been a huge amount of privatisation. There are literally hundreds of billionaires.

The state still owns some critical things, but is that enough to make it communist? Its not everything and you can have state ownership and still have a ruling class that has control of the means of production which it uses to its own advantage.

As China is a communist country with a partly capital economy hoping to transition to socialist society. It is still in the process of transition and AI in its current form and controlled by capitalists will destroy their goal of socialist society. It is different when you have AI that any one can own and use from only the few can afford to own and run.

When Evergrande went down in 2021 a lot of commentary said this would take their whole economy down (or worse) similar to how the subprime mortgage bubble took down the US economy in 2007. That didn’t really happen.