Remix.run Logo
▲ cluckindan 2 hours ago

Neither a chat or an API are an LLM.

▲verdverm 2 hours ago | parent | next [-]

LLM's have chat templates that sit at the lowest levels of how we feed tokens to them. It's quite integral to how they are trained to process tokens and rises up through the tech stack.

Go to a huggingface repo, look at the files, they have a literal chat_template.jinja

▲tptacek an hour ago | parent | prev [-]

By that standard Gebru was also not writing about LLMs in the Stochastic Parrot paper.