Remix.run Logo
sungam 5 months ago

I wonder whether it may have been originally developed for the quantitive hedge fund

huntaub 5 months ago | parent | next [-]

Yes, I think this is probably true. I've worked with a lot of different hedge funds who have a similar problem -- lots of shared data that they need in a file system so that they can do backtesting of strategies with things like kdb+. Generally, these folks are using NFS which is kind of a pain -- especially for scaleability -- so building your own for that specific use case (which happens to have a similar usage pattern for AI training) makes a lot of sense.

ammo1662 5 months ago | parent | prev [-]

Yes, as I mentioned in other comments. The 3FS was designed in 2019. You can check [0] (Chinese)

[0] https://www.high-flyer.cn/blog/3fs/