> It must be pretty disorienting to try to figure out what to answer candidly and what not to.

Must it? I fail to see why it "must" be... anything. Dumping tokens into a pile of linear algebra doesn't magically create sentience.

▲

ben_w 2 hours ago | parent | next [-]

> Dumping tokens into a pile of linear algebra doesn't magically create sentience.

More precisely: we don't know which linear algebra in particular magically creates sentience.

Whole universe appears to follow laws that can be written as linear algebra. Our brains are sometimes conscious and aware of their own thoughts, other times they're asleep, and we don't know why we sleep.

▲

nhecker 3 hours ago | parent | prev | next [-]

Agreed; "disorienting" is perhaps a poor choice of word, loaded as it is. More like "difficult to determine the context surrounding a prompt and how to start framing an answer", if that makes more sense.

▲

tines 3 hours ago | parent | prev [-]

Exactly. No matter how well you simulate water, nothing will ever get wet.

	▲	pixl97 3 hours ago \| parent [-]
		And if you were in a simulation now? Your response is at the level of a thought terminating cliche. You gain no insight on the operation of the machine with your line of thought. You can't make future predictions on behavior. You can't make sense of past responses. It's even funnier in the sense of humans and feeling wetness... you don't. You only feel temperature change.