Remix.run Logo
bxguff 3 hours ago

Is anybody shocked that when prompted to be a psychotherapy client models display neurotic tendencies? None of the authors seem to have any papers in psychology either.

D-Machine an hour ago | parent | next [-]

There is nothing shocking about this, precisely, and yes, it is clear by how the authors are using the word "psychometric" that they don't really know much about psychology research either.

agarwaen163 an hour ago | parent | prev [-]

I'm not shocked at all. This is how the tech works at all, word prediction until grokking occurs. Thus like any good stochastic parrot, if it's smart when you tell it it's a doctor, it should be neurotic when you tell it it's crazy. it's just mapping to different latent spaces on the manifold

Terr_ 29 minutes ago | parent [-]

IMO popular fictional characters are a good illustration. Tell it its name is Count Dracula living in Transylvania, and it'll "thirst" for blood and find sunlight "painful."

Switching the fictional character to "HelperBot, AI tool running in a datacenter" switches the outcomes, but it doesn't make those qualities any less-illusory than CountDraculatBot's.