~~Finally someone doing it correctly. Love this change.~~

Edit: F really misunderstood the change, the title is misleading AF. I should have read the post before commenting lmao.

Absolutely hate it, now I guess... sigh..

Incase the title gets changed it used to say, "Codex starts encrypting prompts, uses ciphertext for inference instead"

▲

LoganDark 5 hours ago | parent [-]

How so?

▲

tempay 5 hours ago | parent [-]

I assume OP interpreted it as encryption that hides the prompts from OpenAI rather than OpenAI hiding information from users.

▲

LoganDark 5 hours ago | parent | next [-]

I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.

▲

fortuitous-frog 5 hours ago | parent [-]

Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.

	▲	LoganDark 5 hours ago \| parent [-]
		When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.

▲

minraws 5 hours ago | parent | prev [-]

ooooooof yeah totally misinterpreted it lmao

▲

skeledrew 4 hours ago | parent | next [-]

Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.

	▲	minraws 3 hours ago \| parent [-]
		I can only say I am a little too optimistic about the technology world in general. Or at least would love to see some good news once in a while given the state of the world.

▲

mpeg 5 hours ago | parent | prev | next [-]

to be fair, the title is very misleading, it took me a minute to understand what they meant

▲

LoganDark 5 hours ago | parent | prev [-]

Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.