The chip is designed to run models with 20 billion to 100 billion parameters (approximately 3 billion to 20 billion active parameters)

Doesn't seem like 100B dense models are even on the table, only MoE models. Kinda misleading.

Not really. Models of that size is reasonably often moe. It is also 100b even if it only has 20b active at a time.