well, yeah, it's based on a 2+ year old tiny model. It's very much an alpha proof of concept that they can perma-bake an LLM into silicon.

https://huggingface.co/meta-llama/Llama-3.1-8B