You should've used recutils probably :)

https://labs.tomasino.org/gnu-recutils/

TIL!

Sharding would be so easy! Just run "split" and spread the chunks over a bunch of servers, then run "recutils" with "parallel" to retrieve!

Truly webscale.