Note that Neel Nanda replicated the results on a Qwen model.

And Neuronpedia released Jacobian lens weights for a wide range of open models: https://huggingface.co/neuronpedia/jacobian-lens