| ▲ | dominotw 2 hours ago | |||||||
i belive gp means llms produce what they see in training data/rl there isnt much too much customization you can do with skills. they are being sold as more powerful than they are. Like llms are intelligent blank slates that can be customized with mere markdown files. | ||||||||
| ▲ | calebkaiser an hour ago | parent [-] | |||||||
I don't understand this line of criticism exactly. By putting new information in the context window, you are materially changing the activations at your point of sampling, which is literally "customizing with mere markdown files." Taken to the extreme, the attitude that there is some special incantation that will unlock all capabilities is silly, and a lot of the "prompt engineering" discourse is similarly kind of dumb, but in-context learning is clearly a real thing. | ||||||||
| ||||||||