Unified Line and Paragraph Detection by Graph Convolutional Networks (2022)

Direct link to the book: https://fhetextbook.github.io/

Is the title broken?

I see “Unified Line and Paragraph Detection by Graph Convolutional Networks (2022)”

	▲	fhe 2 hours ago \| parent [-]
		I see the same, and there is a posting of that title (and linking to the correct paper) also on HN frontpage. wondering what's going on.

▲

Hizonner 8 hours ago | parent | prev | next [-]

I was under the impression that, for any FHE scheme with "good" security, (a) there was a finite and not very large limit to the number of operations you could do on encrypted data before the result became undecryptable, and (b) each operation on the encrypted side was a lot more expensive than the corresponding operation on plaintext numbers or whatever.

Am I wrong? I freely admit I don't know how it's supposed to work inside, because I've never taken the time to learn, because I believed those limitations made it unusable for most purposes.

Yet the abstract suggests that FHE is useful for running machine learning models, and I assume that means models of significant size.

	▲	benlivengood 7 hours ago \| parent \| next [-]
		The difference between homomorphic schemes and fully homomorphic schemes is that FHE can be bootstrapped; there's a circuit that can be homomorphically evaluated that removes the noise from an encrypted value, allowing any homomorphic calculation's result to have its noise removed for further computation.
	▲	pclmulqdq 7 hours ago \| parent \| prev [-]
		Both of these are correct-ish. You can do a renornalization that resets the operation counter without decrypting on FHE schemes, so in that sense there is no strict limit on operation count. However, FHE operations are still about 6 orders of magnitude more expensive than normal, so you are not going to be running an LLM, for instance, any time soon. A small classifier maybe.

▲

EGreg 4 hours ago | parent | prev | next [-]

Funny thing is

Since neural networks are differentiable, they can be homomorphically encrypted!

That’s right, your LLM can be made to secretly produce stuff hehe

▲

sandworm101 7 hours ago | parent | prev | next [-]

What is the computational burden of FHE over doing the same operation in plaintext? I realize that many cloud proponants think that FHE may allow them to work with data without security worries (if it is all encrypted, and we dont have the keys, it aint our problem) but if FHE requires a 100x or 1000x increase in processor capacity then i am not sure it will be practical at scale.

▲

layer8 6 hours ago | parent [-]

It’s at least a million times slower than non-encrypted computation. 1000x or 100x would be a huge progress.

▲

sandworm101 6 hours ago | parent [-]

Oh. It really is that bad still. So if the question is between wrapping the plaintext in layers of security, or building out a million new server instances to do it via FHE, i know which one everyone will choose.

	▲	bgnn 5 hours ago \| parent [-]
		It's so bad that the only way FHE can get more efficient is to use a non-conventional compute technology. Some want to do it in optical donain.

▲

noman-land 9 hours ago | parent | prev [-]

Direct link to the book:

https://fhetextbook.github.io/