Remix.run Logo
▲ verdverm an hour ago

the most widely used API surfaces are already shaped around chat, it's different and most analogies will fall short in some way

▲cluckindan an hour ago | parent [-]

Neither a chat or an API are an LLM.

▲tptacek 30 minutes ago | parent | next [-]

By that standard Gebru was also not writing about LLMs in the Stochastic Parrot paper.

▲verdverm an hour ago | parent | prev [-]

LLM's have chat templates that sit at the lowest levels of how we feed tokens to them. It's quite integral to how they are trained to process tokens and rises up through the tech stack.

Go to a huggingface repo, look at the files, they have a literal chat_template.jinja