> I’m only out the cost of the drive, which is like $40 and doesn’t require anybody on the other side cooperate with me.

At current prices you are also out about $4k for a Spark to actually run the inference on, if you want a full LLM in a low-power package.

In general, I'm not sure why one would want to pin your survival to an expensive, hallucination-prone data source, when an offline copy of wikipedia with a little vector search attached to a Raspberry Pi can fulfil the same role...