Remix.run Logo
ninjin 2 days ago

If you read the interview and walk away with that impression I will be amazed. You may not like his distinction between science and engineering, but he admits it is somewhat arbitrary and as someone that is solidly in the deep learning camp his criticism is not entirely unfair, even if I disagree with it and will not change my own course.

Personally, I find it somewhat amazing that you put Demis on that list given that he, himself, on very good accounts that I have, explicitly pushed back against natural language processing (and thus large language model) development at DeepMind for the longest of times and they had to play major catch up once it became obvious that their primarily reinforcement learning-oriented and "foundational" approaches were not showing as much promise as what OpenAI and Facebook were producing. Do not get me wrong, what he has accomplished is utterly amazing, but he certainly is not a father of large language models.

weatherlite 2 days ago | parent [-]

> If you read the interview and walk away with that impression I will be amazed.

I have not, but I have watched him talk about this things many times and he always seemed too sure of himself and too dismissive of LLMs, I now believe he's simply wrong.