parquet is optimized for storage and compresses well (=> smaller files)

feather is optimized for fast reading

aynyc 3 hours ago | parent | next [-]

Given the cost of storage is getting cheaper, wouldn't most firms want to use feather for analytic performance? But everyone uses parquet.

	▲	yencabulator 2 hours ago \| parent \| next [-]
		You can, still, gain a lot of performance by doing less I/O.
	▲	outside1234 3 hours ago \| parent \| prev [-]
		What people have done in the face of cheaper storage is store more data.

twic an hour ago | parent | prev [-]

And now there's Lance! https://lance.org/