| ▲ | rthnbgrredf 5 days ago | |
> Because it's actually fairly slow. "We were reading data at 635 GiB/s. We broke 15 million 4k random read IOPS." Source: https://ceph.io/en/news/blog/2024/ceph-a-journey-to-1tibps/ I don't know man, I think 15M random read IOPS is actually quite fast. I've built multi million IOPS clusters in enterprise settings all on nvme in the past. | ||
| ▲ | rfoo 5 days ago | parent [-] | |
> I think 15M random read IOPS is actually quite fast 680x NVMe SSDs over 68 storage servers (so 68 CPUs) for just 15M (or 25M, tuned) random read IOPS is pretty underwhelming. The use cases where 3FS (or some other custom designs) shine are more like, 200M random read IOPS with 64 servers each with 8 PCIe gen 4 NVMe SSDs (512x SSDs in total). | ||