Wait until you start digging into open weights models. There you have actual "dense" models as well as "Mixture of Experts" models.