and Glimmer has 10x active params of Lightning. Meaning ~ 10 slower on same HW
Is that the case?
If the entire model fits in vram, won't the tps be comparable?