new | show | ask | jobs Github

elendilm 2 hours ago

> There's not really a difference here between S3 and your disk, aside from the literal amount of latency.

Latency is the whole point.

▲

deathanatos an hour ago | parent [-]

> Latency is the whole point.

The article's title is literally:

> What changes when your search index lives on S3?

None of this changes because your search index lives on S3; there's no property of S3 that says "this is an inherently better format for S3 than it is for disk". The format improvements are independent of the latency difference.

	▲	elendilm an hour ago \| parent [-]
		Article mentions GETs being slower and round trip latency as a major villain multiple times. Article even dedicates a section titled "Caching on disk and in memory" for latency reduction. Latency is the whole point as that is the ultimate villain when you decide to build index search on S3. Its really hard to miss. But otherwise agree.