Remix clone Hacker News

new | show | ask | jobs Github

▲

danielheath 4 days ago

S3 supports multipart uploads which don’t necessarily send all the parts to the same server.

▲

texthompson 4 days ago | parent [-]

Why does it matter where the bytes are stored at rest? Isn't everything you need for SHA-256 just the results of the SHA-256 algorithm on every 4096-byte block? I think you could just calculate that as the data is streamed in.

	▲	jiggawatts 4 days ago \| parent \| next [-]
		The data is not necessarily "streamed" in! That's a significant design feature to allow parallel uploads of a single object using many parts ("blocks"). See: https://docs.aws.amazon.com/AmazonS3/latest/API/API_CreateMu...
	▲	Dylan16807 4 days ago \| parent \| prev [-]
		> Isn't everything you need for SHA-256 just the results of the SHA-256 algorithm on every 4096-byte block? No, you need the hash of the previous block before you can start processing the next block.