Take anything from Microsoft with grain of salt. Remember Phi?

They can’t decide on naming their product in Azure, let alone creating something useful or usable

Phi was pretty revolutionary for its time. The accompanying paper https://arxiv.org/abs/2306.11644 has been pretty instrumental in pushing the idea of highly curated synthetic dataset to train model. The lead scientist behind Phi-1 is now VP at OpenAI and leading their own synthetic training dataset effort.

▲

weberer 3 hours ago | parent | prev | next [-]

Remember Tay AI?

https://knowyourmeme.com/sensitive/memes/sites/tay-ai

	▲	paulmist 2 hours ago \| parent [-]
		I love this video on Tay https://www.youtube.com/watch?v=HsLup7yy-6I

▲

vessenes an hour ago | parent | prev | next [-]

Phi was smart (or had a smart training architecture, more precisely), and arguably pushed the conversation forward globally on the value of curated training data.

▲

samuelknight 3 hours ago | parent | prev [-]

Phi was cool for what it was. But it's not 2024 anymore.