| ▲ | halJordan 6 hours ago | |
Looks like a less good version of qwen 30b3a which makes sense bc it is slightly smaller. If they can keep that effiency going into the large one it'll be sick. Trinity Large [will be] a 420B parameter model with 13B active parameters. Just perfect for a large Ram pool @ q4. | ||