| ▲ | reasonableklout 4 days ago | |
Oh yes, according to [1], training GPT-2 1.5B cost $50k in 2019 (reproduced in 2024 for $672!). [1]: https://www.reddit.com/r/mlscaling/comments/1d3a793/andrej_k... | ||
| ▲ | stavros 4 days ago | parent [-] | |
That makes sense, and it was definitely impressive for $50k. | ||