The demo video is a great example of one thing I have been saying for ages - the quality of the LLM output depends heavily on the communication skills of the user.

Some people say AI is great and some people say AI is terrible - but how can anyone compare these things because they depend so much on the skill of the user.

Case in point - the demo video. The user says "find me all the HCI articles on hacker news" and then a research task started... ok great so far.

Then the user says "they should be made into slides"

What exactly do you mean by this? Do you mean "from the set of results you found, narrow them to be only the ones that have been made into slides" or does the user mean "I would like you to then take those results and make them into slides"

There will be people who read this and say its obviously the former and people who read this and say its obviously the latter, and neither of those is the point I am trying to make, the point is that its very ambiguous and if the AI did the "wrong" one, then the user would complain that AI is garbage but the real problem is that the instruction was very unclear because the users communication skill was poor.