Remix.run Logo
karimf 3 hours ago

Yes, and also waiting for the next iteration of Gemma. Muse or Qwen are optimized for coding, while IMO Gemma is still better for non-coding tasks.

https://x.com/osanseviero/status/2086107547535122767

dannyw an hour ago | parent [-]

You can partially tell by the tokeniser; which gives you some hint into the training corpus mix.

</div> is four Gemma4 tokens, but one Qwen3.6 token.

venusenvy47 27 minutes ago | parent [-]

Where do you find this information for each model?

ComputerGuru 16 minutes ago | parent [-]

The tokenizers are included in the open s̶o̶u̶r̶c̶e̶ weights releases; you wouldn’t be able to use the weights without the corresponding encoder/decoder, in fact.