Remix.run Logo
▲ cubefox 29 minutes ago

> Also, I wonder what happened with GPT 4.5? I think o1 was the start of true reasoning models, right? I was using Claude at the time so I can't remember.

GPT-4.5 was originally internally called Orion and was supposed to become "GPT-5". It was a huge pretrained model. However, as reported by The Information and a few other sources, the results on measured performance were disappointing. Apparently pre-training alone was leading to diminishing returns, at least with standard RLHF. This is why they didn't release it initially, only much later under the downgraded name "GPT-4.5", and only for a short period of time.

Later they invented RLVR (chain-of-thaught reasoning via reinforcement learning), a post-training technique, which dramatically increased model performance, without affecting perplexity. The first model with RLVR was o1. The successor to o3 was then called GPT-5.