Remix.run Logo
LoganDark 5 hours ago

How so?

tempay 5 hours ago | parent [-]

I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.

LoganDark 5 hours ago | parent | next [-]

I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.

fortuitous-frog 5 hours ago | parent [-]

Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.

LoganDark 5 hours ago | parent [-]

When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.

minraws 5 hours ago | parent | prev [-]

ooooooof yeah totally misinterpreted it lmao

skeledrew 4 hours ago | parent | next [-]

Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.

minraws 3 hours ago | parent [-]

I can only say I am a little too optimistic about the technology world in general. Or at least would love to see some good news once in a while given the state of the world.

mpeg 5 hours ago | parent | prev | next [-]

to be fair, the title is very misleading, it took me a minute to understand what they meant

LoganDark 5 hours ago | parent | prev [-]

Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.