| ▲ | senko 4 hours ago | ||||||||||||||||
Since it's a PDF, here's an excerpt from the summary: > This report introduces Kolibri, an English–German Mixture-of-Experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under the Apache 2.0 licence. > We built Kolibri for sovereign and specialised deployment, with a particular focus on German and on regulated domains such as public administration, industry, and aerospace. To support these settings, we control the full model-development process, including data, architecture, training infrastructure, post-training, and evaluation. | |||||||||||||||||
| ▲ | dang 2 hours ago | parent | next [-] | ||||||||||||||||
Comments moved thither. Thanks! | |||||||||||||||||
| ▲ | yu3zhou4 4 hours ago | parent | prev [-] | ||||||||||||||||
It’s not a dupe, it’s a full training and infra report | |||||||||||||||||
| |||||||||||||||||