Well, this is an entirely other category of optimizations - not program performance but model performance.

Yes, in "runtime optimization" the model is just a computation graph so we can use a lot of well known tricks from compilation like dead code elimination and co..