Remix.run Logo
davidatbu 4 hours ago

I can spare a minute :). This isn't exhaustive because this is just stuff I know of, obviously.

- At Stanford, Led research on the first (to my knowledge) crop of joint image/text models. Super widely cited work.

- At Tesla, led their whole self driving effort for a while, came up with critical techniques that allowed them to make progress (e.g., the concept of "auto labelling": using a much larger NN to generate training data with which to train smaller models that could fit in the on-device compute. IIRC, Elon said they would not have been able to make progress without this insight).

I'm not sure his educative efforts for the mold of what you're looking for, but if so, the course he designed at Stanford (and availed online):for neural networks, as well as his blog posts, (most famous of which, to my knowledge, is "the unreasonable effectiveness of LSTMs"), made a huge impact on educating a generation of tinkerers and researchers.

frays 5 minutes ago | parent | next [-]

Karpathy is also badmephisto, a name you might have heard of if you're into cubing.

http://badmephisto.com/

mjg2 an hour ago | parent | prev | next [-]

Tesla still hasn't achieved their 2016 self-drive goal by their self imposed deadline of 2017, even now a decade later. So, politely, is that accolade merited?

momojo 4 hours ago | parent | prev | next [-]

Add microgpt to that list

10xDev 4 hours ago | parent | prev | next [-]

It wasn't LSTMs, it was RNNs.

davidatbu 4 hours ago | parent [-]

Thanks for correcting the title I misremembered. Fwiw, the article did culminate with LSTMs: https://karpathy.github.io/2015/05/21/rnn-effectiveness/

---------------------

EDIT: It looks like you deleted the part of your post I quoted below. So feel free to ignore my question about it, I guess.

---------------------

Not sure what you mean by

> Shows how much you know

Do you mean that the fact that I misremembered a word on the title suggests that I know very little about Karpathy's contributions to the field of neural networks?

kingkongjaffa 4 hours ago | parent | prev [-]

Thank you!

I was more looking for signal that him + Anthropic might yield something beyond a step-change from Opus 4.7 (disappointing so far). We have not gotten to use Mythos yet, I wonder if that will become Opus 5 or something.