Is Sol benchmaxxed? Of course it is. Altman was caught in previous attempts trying to game benchmarks, does anyone believe that he's found his moral compass and decided to stop exploiting as much as he can get away with?

▲

letmevoteplease 3 hours ago | parent | next [-]

> Altman was caught in previous attempts trying to game benchmarks

Sounds like something you just made up, or maybe you read it on some other Reddit/HN post and started repeating it because it aligned with your biases.

> does anyone believe that he's found his moral compass and decided to stop exploiting as much as he can get away with?

I don't think "OpenAI" is equivalent to "Sam Altman." I think if OpenAI was intentionally "benchmaxxing" purely for marketing purposes that information would leak, because OpenAI is full of good-faith researchers (although it can be difficult to avoid overfitting even if you're actually trying to improve the model's general abilities)

And lastly I think anyone can actually try Sol themselves and see that's it a good model, or if that's too subjective, it is clearly better than the previous version. The benchmarks are reflecting actual progress and anyone can verify this themselves.

	▲	kzrdude 2 hours ago \| parent \| next [-]
		There's this whole discussion going on about agents being more independent now. They don't follow instructions so well, they continue until the problem is done (sometimes too long), they don't ask the user for feedback. That is a kind of benchmaxing: they are made to complete benchmarks tasks and one-offs well, and no longer work well in tandem with the user. Regardless what you call it, it's a divergence between what the power user wants and what the model developers want, I think.
	▲	vlovich123 3 hours ago \| parent \| prev [-]
		Yeah and Astra is much better still

▲

general_reveal 3 hours ago | parent | prev [-]

[flagged]

▲

moomin 3 hours ago | parent [-]

A lot of people seem to be the Antichrist these days. I’d have though we’d get a lull after the millennium but it’s all the rage.

▲

general_reveal 3 hours ago | parent | next [-]

Well, the antichrist should be in and around this AI thing for one particular reason:

The devil cannot create anything of his own because he is not God, by definition. We have already observationally defined generative AI as something that cannot create anything novel in the sense it cannot output anything it has never seen (cannot create new, always a re-assortment of what is).

In that way , AI is a perfect mimicry of how the devil operates (in totality, as the devil perverts and replicates anything good, often subtly and always deceptively), which is to thieve off God, steal.

So he would be around, if you catch my drift, right about now. And I wouldn’t be shocked if he’s on HN, and that he would chose technology as the vessel. And ultimately, when it’s all said and done, I would not be shocked that those who studied and developed AI, did so for the devil whether they were aware or not.

Anyway, let a poor Christian have his end-times hypothesis.

▲

icantevenhold 3 hours ago | parent | next [-]

What’s the antichrists goal though?

Create hell on earth or turn us all into heretics or something else?

▲

general_reveal 3 hours ago | parent [-]

Anti Christ goal:

Achieve total global dominance and become the object of worship over God, while killing all those who stay faithful to Jesus Christ.

Those who stay faithful see Heaven, those who don’t, see the Lake of Fire. It’s the final separation of the wheat from the chaff.

As per Revelations. Thank your for allowing me to edify :)

▲

johnsmith1840 2 hours ago | parent | next [-]

It's actually pretty cool of these old stories how well that maps to a dangerous tyrant.

The roman empire perfectly matched that and most powerful men seem to go that path.

It would also be kinda easy to argue many moderns countries are going down that path.

▲

bookshaman 2 hours ago | parent | prev [-]

So, we're rooting for the Anti Christ then? I might have to change my stance on generative "ai" then.

	▲	2 hours ago \| parent [-]
		[deleted]

▲

cindyllm an hour ago | parent | prev [-]

[dead]

▲

ZeWaka 3 hours ago | parent | prev [-]

I guess we also need more antipopes.