Remix.run Logo
cynicalsecurity a day ago

I'm eager to replace battle-tested rsync with a new half-baked tool that no one uses for a tiny speed improvement. I'm also going to enable automatic updates of that tool too.

greaber a day ago | parent | next [-]

I'm seeing 5x speedups on my real workloads, and you can see some synthetic benchmarks here or run your own https://greaber.github.io/syq-bench/

throw1234567891 a day ago | parent [-]

what's a "synthetic benchmark", claude came up with those numbers by looking at the code?

greaber a day ago | parent [-]

They are benchmarks on real hardware, and I tried to provide enough details so that anyone can reproduce them (but some of the benchmarks are on servers I have that you can't order on public cloud -- these ones are clearly marked). "Synthetic" means that the data is synthetic, not an actual production workload. For instance, some of the benchmarks use files filled with random bytes.

throw1234567891 a day ago | parent | next [-]

So real benchmarks with synthetic data.

beepbooptheory a day ago | parent | prev [-]

Do non-randomly ordered bytes produce different results??

greaber a day ago | parent [-]

Syq has compression turned on by default. Also, if you are updating a file that already exists on the other end, syq will only send blocks of the file that changed.

xorcist a day ago | parent | prev | next [-]

"Tiny" speed improvement? According to the benchmarks, it's almost 10x the speed of rsync!

Really serious benchmarks never contain any information about network characteristics, options used or buffer sizes, and these are indeed very serious. The "details" button produces huge bar graphs. No disappointment there.

Absolutely looking forward to 10x my speed, perhaps even transferring gigabytes per second on my gigabit link.

xz18r a day ago | parent | prev [-]

You live up to your username!