Doesn't PCA compress the embeddings in this case, ie reduce the accuracy? It's similar to quantization.

Component analysis doesn't fundamentally reduce information, it just rotates it into a more informative basis. People usually drop vectors using the eigenvalues to do dimensionality reduction, but you don't have to do that.