| ▲ | stkai 4 hours ago | |||||||||||||||||||||||||||||||||||||
Would love to find out they're overfitting for pelican drawings. | ||||||||||||||||||||||||||||||||||||||
| ▲ | andy_ppp 4 hours ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||
Yes, Racoon on a unicycle? Magpie on a pedalo? | ||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||
| ▲ | theanonymousone an hour ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
Even if not intentionally, it is probably leaking into training sets. | ||||||||||||||||||||||||||||||||||||||
| ▲ | fragmede 3 hours ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||
The estimation I did 4 months ago: > there are approximately 200k common nouns in English, and then we square that, we get 40 billion combinations. At one second per, that's ~1200 years, but then if we parallelize it on a supercomputer that can do 100,000 per second that would only take 3 days. Given that ChatGPT was trained on all of the Internet and every book written, I'm not sure that still seems infeasible. | ||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||