Remix.run Logo
▲ laichzeit0 7 hours ago

Have no idea why you’re being downvoted as this is a very valid point.

Also, in principle everything a GPU does could be done on pencil and paper. You could distribute the entire forward pass to the whole of humanity and have them write it out. Even if it took millions of years, the point is it’s computationally reducible to hand calculation. Is that entire process now “conscious” as well? The only difference would be the clock rate.

▲winwang 3 hours ago | parent [-]

While this is an interesting point, I'd say that this is also true of a human brain.

▲laichzeit0 3 hours ago | parent | next [-]

It’s an assumption, with the LLM it is a fact. There is only one source of entropy, whatever the seed value is to any pseudo random number generator used for stochastic operations. Given those values, everything is deterministic. For the brain, it’s not at all obvious that this is true.

▲chrisjj 3 hours ago | parent | prev [-]

We have the LLM code.

You don't have the brain code.