The GPT-1 responses really leak how much of the training material was literature. Probably all those torrented books.