Remix.run Logo
didgetmaster 3 days ago

Local hard drive are big enough these days to hold hundreds of millions of files. That means that you could have many millions of each type of file (documents, pictures, spreadsheets, videos, etc.)

We need better ways to properly classify all that data with accurate metadata and quick ways to pick out a small subset of data for A.I. to analyze.

Databases were designed to do this with relational tables (e.g. find all customers from New York who bought our product in 2024); but file systems were not designed to do this with files (e.g. find all pictures I took with my phone in 2020).

A.I. can be a great tool to find patterns in files to answer important questions, but it will be incredibly slow if it has to analyze too many files for every query.

oblio 2 days ago | parent [-]

The low level, file system, solution will probably not be widely implemented within my lifetime.

didgetmaster a day ago | parent [-]

Unfortunately, I tend to agree. I created a great solution (I think), but I am not Microsoft or Apple so getting any traction for it is incredibly hard.