Microsoft has been releasing LLMs for years.

ipsum2 6 hours ago | parent | next [-]

Sort of. Phi models were just trained on GPT outputs though.

	▲	kingstnap 5 hours ago \| parent \| next [-]
		For those that don't know about this. Phi was announced with a paper called "Textbooks are all you need". What they did was use GPT 3.5 and created synthetic textbook chapters and exercises. They also did some more interesting work like showing very small models can be coherent as long as you have very simple children's book style training data (TinyStories is pretty famous). Lots of these ideas are still used. Learning facts at scale with active reading is an ICLR 2026 paper from Meta AI that does a lot of similar work.
	▲	not_a_bot_4sho 5 hours ago \| parent \| prev [-]
		By design. The whole point of Phi is the "textbooks is all you need" theory on curated training data, as opposed to kitchen sinks.

lemonish97 6 hours ago | parent | prev | next [-]

They were mostly distilled or fine-tuned OAI models.

huh? The granite series isn't distilled

	▲	wirybeige 5 hours ago \| parent [-]
		Granite is IBM

jwitthuhn 6 hours ago | parent | prev [-]

And occasionally un-releasing them like with WizardLM.