Remix.run Logo
▲ segmondy 9 hours ago

I'm not talking about Hy4 Preview. I'm talking about Hy4, it was announced this morning. - https://hy.tencent.ai/research/hy4

▲zozbot234 9 hours ago | parent [-]

Is there any evidence that Hy4 proper is a new architecture compared to Hy4 Preview? Mind you, the Preview page explicitly says "we're not even done with pretraining, let alone model fine-tuning".

▲segmondy 9 hours ago | parent [-]

Oh ok, I see what you mean, you are just comparing them by weight. In that case, it tracks that K3.1 will have more knowledge. It's the same architecture. I'm just saying that for how large K3.1 is, intelligence by weight, it's not crushing DSV4.1 or Hy4