Remix.run Logo
rahimnathwani a day ago

If your data aren't too large, you can use faiss-cpu and pickle

https://pypi.org/project/faiss-cpu/

notyourwork 14 hours ago | parent | next [-]

For the uneducated, how large is too large? Curious.

itake 13 hours ago | parent [-]

FAISS runs in RAM. If your dataset can't fit into ram, FAISS is not the right tool.

hahahahhaah 12 hours ago | parent | prev [-]

Shoud it be:

If the total size of your data isn't loo large...?

Data being a plural gets me.

You might have small datums but a lot of kilobytes!

pousada 8 hours ago | parent [-]

Data is technically a plural but nobody uses the singular and it’s being used as a singular term often - which is completely fine I think, nobody speaks Latin anyway

DonHopkins 4 hours ago | parent [-]

The opposite of Data is Lore.