> It knows less from memory, Multi-turn tool calling is weaker, It’s not the best coding agent

Then what does it good at? Sending faxes?

I don't have the hardware to test this, but being trained to say "I don't know" instead of misleadingly talking confidently about what it does not know is interesting in itself.

I suspect there are a lot of German companies that have thousands of documents that describe their software/product. Adding or changing a feature means you have to ask 20 people whether there might something that can break some edge case behavior for which no (automatic) test exists. In this case, it would be nice to have a virtual employee who knows the content of all documents.

I even experienced the opposite case: Some feature was first rejected since everyone agreed that it would break some behavior. After talking to several people again, I discovered that the use case which required this behavior did not exist anymore and had been officially phased out years before. Maybe, some RAG LLM could have told me, based on company documents, that there is some edge case that can be removed making the way free for the new feature.

Seems like it's good at reading German documents and reasoning over them. Custom German-language tokenizer, and one of the least hallucinating models.

Well that’s a pretty important skill for German users!

GPT was better at chat and rag before coding

I was thinking about the use cases for Germany residents actually, but yes, you're right. A German AI model needs to be able to handle fax machines (there's a bit variety of them) and also needs to handle letters coming home. german image-to-text.

[flagged]