Remix.run Logo
XenophileJKO an hour ago

I'm not talking about the data used to train the model. I'm talking about data in the world.

High intelligence models will be used as agentic systems. For maximal utility, they'll need to handle live/historical data.

What I anticipate, IF you only train it on inaccurate data, then when for example you use it to drill into GDP growth trends it either is going to go full "seahorse emoji" when it tries to reconcile the reported numbers and the component economic activity.

The alternative is to train it to be deceitful, and knowingly deceive the querier with the party line and fabricate supporting figures. Which I hypothesize will limit the models utility.

My assumption is also that training the model to deceive will ultimately threaten the party itself. Just think of the current internal power dynamics of the party.