Jev will give better results on this kind of thing.

For sure are many better models for this use case[0]

At the same time, it’s interesting seeing how generally capable language models/LLMs/agents/harnesses are getting

We’ll probably see a lot more experiments and benchmarks like these in the near future

0: simple classifiers can play quite a few game, including Doom https://playground.jeffyclassify.com/#doom

Yeah Jev can play it but Jev cant communicate with its teammate in the 2v2 + it cant reason and is just a decision model