▲ | deevus 4 days ago | |
I’m really interested in this space from an AI sovereignty pov. Is it feasible for SMB/SME to use a box like in the article to get offline analysis of their data? It doesn’t have the worry of sending it off to the cloud. I wanted to speak with businesses in my local area but no one took me up on it. | ||
▲ | ang_cire 4 days ago | parent | next [-] | |
Yes, this is absolutely doable, and many companies are rolling their own ML models (I work with a MedTech company that does, in fact). LLMs are a little more involved, and you'd probably want something beefier than this (maybe a Framework Desktop cluster, if you're not wanting to get into rackmount stuff), but it's definitely feasible for companies to have their own offline LLMs and ML models. | ||
▲ | 4 days ago | parent | prev [-] | |
[deleted] |