Feels like the author hits the nail on the head but leaves out higher cardinality data. Would love to know how Anthropic goes about ingesting and analyzing their logs, of which they presumably have many.

Ingesting? Presumably Kafka. Analyzing? Presumably a fairly large analytics org.