Funny thing is

Since neural networks are differentiable, they can be homomorphically encrypted!

That’s right, your LLM can be made to secretly produce stuff hehe

That's pretty cool, but isn't any computable function can be computed via FHE, so I'm not sure the differentiable part is necessary.