| ▲ | stri8ted 9 hours ago | |
You seem to assume training on pelican would not result in improved performance on other similar tasks. Why? | ||
| ▲ | altcognito 9 hours ago | parent | next [-] | |
He didn't. That's why the article exists. You have to do the science to see if it does. He was asking the question - do we see gains across other tasks? The underlying question was: Is the additional attention given to this specific task creating a false impression of progress? | ||
| ▲ | HarHarVeryFunny 8 hours ago | parent | prev [-] | |
Either you've memorized the outline (or detailed component shapes) of, say, a horse, or you haven't. Memorizing the outline of a pelican isn't going to help you with the horse. You could train a model to do something a bit different like a pencil sketch, or vector graphic sketch, of something given a photo of it, and expect that to be a generalized skill, but if you are asking the model to do it "from memory" then memorizing a pelican is no substitute for not having memorized a horse. | ||