It's about weights/parameters, not representations.
True, good point, maybe not a straightforward consequence to extend to weights.