| ▲ | snaking0776 a day ago | ||||||||||||||||
This is cool but I don’t know if the comparisons to conscious awareness really make sense here. Their definition of the J-Space is basically the expectation of how much a final logits output would change as a result of a small change in a particular layer (see past work on information geometry). This seems more to me like showing there exists an abstract reasoning subspace which is generally shared across different contexts. I guess you can relate it to humans but I’d prefer a more direct claim in a paper rather than having to present things in this more fluffy way. | |||||||||||||||||
| ▲ | nullbio a day ago | parent | next [-] | ||||||||||||||||
Writing it honestly would defeat the whole point of it, that being, to push the narrative that their magical token predictor is conscious. They've been trying this for years now. This video is discussing a paper they published 2 years ago by the way... It's nothing new. | |||||||||||||||||
| ▲ | geraneum a day ago | parent | prev [-] | ||||||||||||||||
> I’d prefer a more direct claim in a paper This is not written to be just a paper. The target audience include media and online forums, and then maybe academia. Edit: typo | |||||||||||||||||
| |||||||||||||||||