> The shorter connections could lead to faster rise times though, right?

Not if you replace that length with more capacitors stacked on top of each other.

Hah, yeah.

I've been naively assuming they are now making high quality vias, so that circuit characteristics would be similar in either vertical or horizontal direction.