Remix.run Logo
AndrewKemendo 11 hours ago

Self host your own LLM

singleshot_ 10 hours ago | parent | next [-]

Why do you think this would be less discoverable than hosting your own email server?

QuadmasterXLII 10 hours ago | parent | next [-]

If you use a stateless client (like just rawdogging cli llama.cpp) there’s nothing to discover. Setting a program with an option to have logs to not do that could conceivably get you in trouble but using a widely used program that never had logs seems like it has to be fine. Maybe they could nail you for googling “which local llm approach generates logs?” also, don’t get nailed by your bash history!

kevin42 10 hours ago | parent | prev | next [-]

Because you don't keep logs.

AndrewKemendo 8 hours ago | parent | prev [-]

Because nobody would know about it unless you told them for some reason

nvr219 10 hours ago | parent | prev [-]

You’d need to hand that mac mini over if subpoenaed

AndrewKemendo 8 hours ago | parent [-]

Can’t hand over something that doesn’t exist if it’s running in a VM container and gets destroyed every 12 hours