It's kind of insane that one of OpenAI's internal test tasks is now "reimplement SQLite from scratch, preserving binary compatibility with existing database files".

▲

anonymous908213 an hour ago | parent | next [-]

There's nothing insane about writing a de/serializer for an open source format with tests telling you every time you get it wrong to fix in a loop. Insane would be if they were willing to entrust critical production data to their vibecoded replacements (in multiple ways).

▲

favorited an hour ago | parent | next [-]

Most of the SQLite test suite, TH3, is not open source or available to the public. You need to pay an undisclosed amount of money to access it, which would seem to defeat the already dubious proposition of vibe-coding a SQLite clone.

https://sqlite.org/th3.html

	▲	dist-epoch a minute ago \| parent \| next [-]
		OpenAI paid $15 mil to solve a math problem
	▲	fp64 44 minutes ago \| parent \| prev \| next [-]
		I would think OpenAI licensed the tests, their availability might have been a reason for picking sqlite for this "benchmark" in the first place
	▲	anonymous908213 an hour ago \| parent \| prev [-]
		> which would seem to defeat the already dubious proposition of vibe-coding a SQLite clone. For an individual, but for OpenAI this would be a trivial marketing expense. The purpose is not actually to replace SQLite but to be able to claim your software is capable of it, to perpetuate the ongoing mania.

▲

kragen 37 minutes ago | parent | prev [-]

If you had told me five years ago that OpenAI was going to be able to do this at all, much less that they were going to do it routinely as a test of new AI models, I would have thought you were being so unrealistically optimistic that I might have suggested that you up your dosage of antipsychotic drugs.

I mean, if you had said they definitely would not be able to do this, I would also have thought you were probably kind of stupid. But we're definitely on the path that looks like AIs keep getting smarter with no limit in sight.

▲

sarchertech an hour ago | parent | prev | next [-]

Have they released this publicly? This seems about on the same order of difficulty to anthropic’s C compiler project, which ultimately failed. I’m surprised if they can do SQLite they wouldn’t show up Anthropic with a real working C compiler.

	▲	kragen 30 minutes ago \| parent [-]
		Maybe C compilers are actually harder?

▲

dist-epoch 2 minutes ago | parent | prev | next [-]

You missed the "solve unsolved math problem, because all other are too easy" tasks

▲

fnordpiglet an hour ago | parent | prev | next [-]

And they do it in powershell

	▲	Negitivefrags an hour ago \| parent \| next [-]
		And if you thought that was ridiculous, consider that the "best" implementation is the SQL database it wrote in PHP.
	▲	wiseowise an hour ago \| parent \| prev [-]
		Isn’t powershell just a C# (.Net) with an ugly syntax?

▲

an hour ago | parent | prev [-]

[deleted]