| ▲ | buckle8017 4 hours ago | |
They over purchased hardware. This is very likely priced below recovering the cost of the hardware but still above operating expenses. | ||
| ▲ | paxys 3 hours ago | parent | next [-] | |
That’s ridiculous. Every major AI lab is compute constrained. That’s exactly why nvidia is worth trillions today. If OpenAI had a single extra GPU they’d be using it to run another training cycle or experiment for their next model. | ||
| ▲ | infecto 4 hours ago | parent | prev | next [-] | |
What evidence is there? I have no idea either way but one thing that detracts from these threads is folks claiming things as a fact without evidence. | ||
| ▲ | qntmfred 3 hours ago | parent | prev [-] | |
sama literally just said they wish they had bought more. the price drops are almost certainly due to good old fashioned hardware innovation (wafer scale with cerebras) and optimizing hardware development based on model architecture and inference costs. other inference providers will try to do the same if they can. | ||