Remix.run Logo
randomImmigrant 42 minutes ago

What the blogificafion of AI research has done is allowed all kinds of claims and terminology related to AI to be introduced and taken up in a manner replicating social media dynamics. And that is simply not healthy. We’re fast reaching a place where any claim can be backed up with a set of numbers from a number of experiments run in some gamified environment or the other, with little concern for if it all adds up to anything. It’s a vicious loop, because this same junk then goes in to train the next models which help spit out the next set of models AND blogs/papers. The net effect is not dissimilar to setting termites loose in a library.

gowld 41 minutes ago | parent [-]

How is that different from traditional research publication? It's faster?

randomImmigrant 6 minutes ago | parent | next [-]

Top line difference is speed. The impact of speed is deeper and gets felt over time.

Traditional research publications are no angels. They gatekeep research, and also allow financial incentives to drive them to publish junk with their stamp on it.

But a flood of papers doesn’t actually mean more knowledge. In bypassing this route entirely, AI has swiftly lost the ability to engage with itself as a field. And the cost of that is only beginning to be felt.

shimman 25 minutes ago | parent | prev [-]

No traditional research is mostly done by post-docs and have a phd level of education rather than a tech bro that passed leetcode. That seems like a good bar to have; not too mention the whole peer review thing, hard to really understand anything if you purposely withhold it and tell people to kick rocks.

janalsncm 5 minutes ago | parent | next [-]

Two separate axes here: whether the research is in a blog, and whether it’s peer reviewed.

On the first, I mostly don’t care.

On the second, that’s mostly unavoidable if they want to keep their IP.

greazy 9 minutes ago | parent | prev | next [-]

Plenty of research is performed by non PhDs.

The main difference is reproducibility and peer review process.

sndgndgndgndy 7 minutes ago | parent | prev [-]

Science is a method of inquiry, not an institution or group of people with titles.