Remix clone Hacker News

new | show | ask | jobs Github

▲

heaney-555 4 hours ago

The benchmark you linked to shows GPT-6 Astra having the lowest hallucination rate of all tested models.

▲

jdiff 4 hours ago | parent [-]

The blog post makes no mention. If the rate isn't 0% it should be mentioned for a field like this.

▲

TomGarden 4 hours ago | parent | next [-]

Agreed. Hallucinations and reliability are the main hurdles to anything being 'agi' in my book

	▲	Tanjreeve 4 hours ago \| parent [-]
		The definition of AGI is whatever a frontier lab wrote a blog about doing in the last week.

▲

simianwords 4 hours ago | parent | prev [-]

why this maximalism? There's nothing that has 0% hallucination including humans. lets use reasonable baselines.

▲

drakythe 4 hours ago | parent [-]

Humans can be sanctioned and fined, and eventually disbarred if they continue to lie in court filings.

▲

john_strinlai 3 hours ago | parent [-]

presumably that will remain true for the lawyers using the product

▲

jdiff 2 hours ago | parent [-]

So those lawyers will likely want to know about the likeliness of it, strategies to work around it, and overall mitigations.

It might be helpful if the company launching this product included such information in their blog post instead of ignoring it in a field with such a high cost of getting it wrong.

	▲	john_strinlai 2 hours ago \| parent [-]
		agreed, but i dont think there are many (any?) product launch blogs that cover all the fine details and legal minutia of the product. that all typically comes in pages of terms of service, purchase contracts, SLAs, conversations with your rep, knowledge base articles, and that sort of thing. not in the initial marketing post. probably available by the "contact legal sales" link at the top of the post https://openai.com/business/contact-sales-legal/