Jev does it more efficiently because it doesn't use an LLM https://typesafe.ai/blog/introducing-system-one-models-and-j...

▲

rockinghigh 14 minutes ago | parent [-]

Their marketing language is misleading. They must still use some transformer language model backbone to encode the text input (BERT or decoder-only LLM). The biggest difference is the output, instead of auto-regressively generating tokens, they produce probabilities over a bounded set of decisions (more flexible classification).

	▲	kgeist 6 minutes ago \| parent [-]
		Stock LLMs already internally produce probabilities before selecting the next token, they're just currently predominantly post-trained for chat/tool calls, not for selecting options A/B/C in the first token.