Conflicted about this study. On one hand, LLMs have been incredible for my personal learnings of new concepts.

On the other, I'm sceptical of that it'll have "strong benefits" at scale; I'd be more in favor if the wording was "some"/"moderate". I reckon self-selection plays a huge part, as mentioned in the "Limitations" section of the paper.

I'd also caution against attaching the tool to grading. That means students have to put more effort into the course, which increases the chances that they will use LLMs to save time rather than make the investment.

▲

zerobees 4 hours ago | parent [-]

> LLMs have been incredible for my personal learnings of new concepts.

Mind if I ask what did you learn and how you're using it?

The reason I'm asking is that I repeatedly felt excitement only to realize down the line that the explanations didn't actually translate into practical skills. I'm not sure it's even an AI problem, it's a "doing versus reading" problem. Same as with reading a pop-science article and thinking to myself that I learned something about physics or medicine or mathematics.

	▲	mmarian 4 hours ago \| parent [-]
		Various concepts when I joined new teams in domains I've never worked in before. And system design. So very practical, and where stakes were high.