I sometimes have things to discuss with LLMs, which are more private than usual. I was thinking how to do it in a way that doesn't reveal my identity.

  1. Use Tor to access the provider?
  2. Create a random account?
  3. Use some form of untraceable payment (which one?)
  4. Scrub all information provided to the LLM from personally identifiable information?

Running Local LLM isn't really a lot effort anymore, since its one command away to get the familar interface of chat AI. This setup requires 24GB ish VRAM and 32GB ram, so if you have capable gaming PC which can do AAA games, you can run it.

- llama-server -hf ggml-org/gemma-4-26b-a4b-it-GGUF:Q4_K_M

After that simply open browser and enter: http://localhost:8080

What this does: This will download Gemma4 AI with 26B param & start a http server for chat

Its shockingly capable for its size. Does it beat the top end models? No, but as long your don't fall into the hallucations. Its just fine.

Edit: the software is llama.cpp you can download it from "releases" which u can find at github right side. No need to know how to build it

Edit2: Pro tip is, only use chat per context you want to use. Lots users want "dynamically" change the context, but that doesnt really work from my experience.

With llama.cpp, Intel i9-13900KS CPU, 96 GB RAM, RTX 4070 running locally.

The models I'm using right now with that are:

  gpt-oss-120b-F16.gguf
  Qwen_Qwen3.5-27B-Q4_K_M.gguf
  Qwen3.6-35B-A3B-UD-Q5_K_XL.gguf
  gemma-4-31B-it-UD-Q6_K_XL.gguf

The hardest part isn’t payment; the prompt itself may identify you. For truly sensitive topics, I’d abstract the details first, then use a local model—or avoid an LLM entirely.

Maybe try Ollama Cloud, Prompt or response data is never logged or trained on:

https://ollama.com/pricing

Best is to use local LLMs obviously. I haven't used it but nano-gpt accepts crypto payments.

https://cake.nano-gpt.com

I spin up a gpu instance in a cloud, run my model via vllm, connect to it via an ssh tunnel. done.

I don't

i've been using OpenAI's os PII-masking model, works decently and lightweight enough to run virtually anywhere https://huggingface.co/openai/privacy-filter

Can't you do it logged out?

With a local one