Hallucinate -> do an experiment -> see it fails, try again. Hallucinate -> do an experiment -> it works, model innovated.

Agentic models brush up against reality, this gives a way around the hallucination problem.

Here is a recent talk showing that hallucination and discovery are actually positively coupled. https://www.youtube.com/live/ZNlZsI9kBm4?si=nhn4ancXu7s6qtom...

▲

TeMPOraL 2 hours ago | parent | next [-]

Ground breaking thought (ML Researchers Will Hate Me For): (some) hallucinations are actually creativity.

▲

weard_beard 39 minutes ago | parent [-]

Creativity unbound by reference is not even dada (which was reactionary) it is noise

▲

TeMPOraL 32 minutes ago | parent [-]

Because - it's the part people are having hard time to accept - creativity was never the hard part. It's randomness. The hard part is navigating the narrow border between "not enough random, therefore boring" and "too much random, therefore unhinged/insane".

That border is determined not as much by ground truth, as by people's sentiment. As such, many famous artists and creatives never succeed navigating - their contemporaries would call them crazy, and then decades or centuries later, the border shifts, and suddenly they're remembered as greatest creators of their era.

	▲	weard_beard 15 minutes ago \| parent [-]
		That is not true at all. As I previously stated: reference, stealing well, blending styles in new ways that obey or break the rules of your art form… what appears random to outsiders is a story that follows as naturally as 2 after 1 if you understand the context. Until an AI can have desires or experience life it cannot tell a story. Even if it could it is questionable if such alien experience qualifies as story. It can retell stories. It can swirl around extant media like a child playing with its dinner. It cannot blend in its own lived and new perspectives which is what gives new art value.

▲

emp17344 2 hours ago | parent | prev [-]

In practice, hallucinations have only mitigated within verifiable domains. The vast, vast majority of human activity is unverifiable, or at least significantly less verifiable than mathematics.