| ▲ | epolanski an hour ago | |||||||
Also privacy and offline capabilities. | ||||||||
| ▲ | DanielHB 39 minutes ago | parent [-] | |||||||
One thing I realized is just how much offline local models can hurt mass data collection. For example, I needed to write an invitation letter for immigration control for a relative visiting me. Previously I would have used a search engine for a template. Today I fire up my local qwen 3.5-9b for this kind of stuff and feed it all the private data I need. Unfortunately it is unlikely the average user will known how to avoid this data collection. Even if the LLM is local you are likely feeding the prompts to remote servers if you harness/chat-interface is not properly vetted. | ||||||||
| ||||||||