How could they possibly included in the previous training run which takes months to complete..

I won't take a side in things, but OpenAI stated the model they used here started training August 28th. Note that "training" here might mean "post-training with RLHF an Astra base model" or something. but training had only started a little over a week earlier.

▲

jazzyjackson an hour ago | parent | prev | next [-]

Has it not been the usual process to snapshot a model to use for inference while continuing to run the training process? I guess you can’t add to the training corpus once you begin? Just trying to make sense of whether training begins or ends as rigidly as you suggest.

▲

s900mhz 4 hours ago | parent | prev | next [-]

IMO It’s not about being trained on the data, it’s more like what do the agents have access to during inference? Can they grep customer transcripts/logs?

	▲	bethekidyouwant an hour ago \| parent [-]
		You’re saying that when they we’re trying to solve this theorem they also shoved in its context somebody else’s chat logs? Bruh.

▲

metanonsense 4 hours ago | parent | prev [-]

Maybe the boundaries of the memory subsystem are a bit fuzzy.