| ▲ | ACCount39 2 hours ago | |
Yes, the mapping function is the thing you're missing. When it comes to representational similarity analysis, we're trying to isolate the representations from the "coordinate systems" they sit in. If you take an image, and make a second image by rotating it 90 degrees and mirroring it, then, for the purposes of platonic representation hypothesis, they're the same image. Once you get past the "coordinate transform", the similarity between the first representation space and the 90-deg+mirror replica of it is total. A mapping function between LE and BE can be constructed easily, and it's going to be lossless both ways. Which means that those two representations are fully compatible. Now, INT16 and FP16? Those are far less compatible representations. There will be an overlap subspace where lossless conversion between the two is trivial, but this compatibility window will be relatively narrow. | ||