LLM can't be trained that easily. More like actual human are checking your logs and stealing valuable things from you.

Or searching anonymised logs for mentions of this problem and using that as part of the context or training.

This would work just as well and have plausible deniability.

They wouldn't appear in weights but could be added to the context. My conversations regularly go "regarding your Java problem"... which was a separate item in the history from earlier. As long as I only see these (and nobody else sees mine), it can be helpful.

LLMs can learn from one sample.