There is a staggering number of user doing this with extra steps using fsx for lustre, their life greatly simplified today (unless they use gpu direct storage I guess)

Good point. There's a wide gulf between being able to design your workflow for S3 and trying to map an existing workflow to it.