Remix.run Logo
porphyra 6 days ago

pretty wild versioning that GPT 4.1 is newer and better in many regards than GPT 4.5.

asdev 6 days ago | parent | next [-]

it's worse on nearly every benchmark

porphyra 5 days ago | parent | next [-]

OpenAI themselves said

> One last note: we’ll also begin deprecating GPT-4.5 Preview in the API today as GPT-4.1 offers improved or similar performance on many key capabilities at lower latency and cost. GPT-4.5 in the API will be turned off in three months, on July 14, to allow time to transition (and GPT 4.5 will continue to be available in ChatGPT).

https://x.com/OpenAIDevs/status/1911860805810716929

brokensegue 6 days ago | parent | prev [-]

no? it's better on AIME '24, Multilingual MMLU, SWE-bench, Aider’s polyglot, MMMU, ComplexFuncBench

and it ties on a lot of benchmarks

asdev 6 days ago | parent [-]

look at all the graphs in the article

brokensegue 6 days ago | parent [-]

the data i posted all came from the graphs/charts in the article

mhh__ 6 days ago | parent | prev [-]

I think they're doing it deliberately at this point

hmottestad 6 days ago | parent [-]

Tomorrow they are releasing the open source GPT-1.4 model :P

mhh__ 3 days ago | parent [-]

I'm apparently dyslexic enough that I only just noticed the joke 2 days later