> Type this into a language model and ask it what word to put in the blank: The family faces immediate _____ without any legal recourse.

For what it's worth, Claude Opus 4.7 says "eviction" (which I think is an equally good answer) but adds that "deportation" could also work "depending on context". https://claude.ai/share/ba6093b9-d2ba-40a6-b4e1-7e2eb37df748

I know you're just sharing a single sample, but is this even the same test? In the article, the model is being inspected while generating the next token(s), and the probabilities are listed.

Here, you're asking the model to retrospectively fill in a missing word, and it's answering your prompt. We have no idea what the actual token probability in Claude is and no way of probing it by asking it.

Same with Gemini

https://g.co/gemini/share/81489f4f8c78

FWIW eviction was what I immediately thought would fill in the blank, and without the Trump presidency, I think deportation would probably be a lot less common of a choice despite fitting quite fine.

cool!

[dead]