I don't think model code is a big deal compared to the idea. If public can recognize the value of idea 11 months ago, they could implement the code quickly because there are so much smart engineers in AI field.

▲

jstummbillig a day ago | parent | next [-]

If that is true, does it follow this idea does not actually have a lot of value?

▲

fancy_pantser a day ago | parent | next [-]

Student: Look, there’s hundred dollar bill on the ground! Economist: No there isn’t. If there were, someone would have picked it up already.

To wit, it's dangerous to assume the value of this idea based on the lack of public implementations.

	▲	lukas099 a day ago \| parent \| next [-]
		If the hundred dollar bill was in an accessible place and the fact of its existence had been transmitted to interested parties worldwide, then yeah, the economist would probably be right.
	▲	NavinF a day ago \| parent \| prev \| next [-]
		That day the student was the 100th person to pick it up, realize it's fake, and drop it
	▲	dotancohen 15 hours ago \| parent \| prev [-]
		In my opinion, a refined analogy would be: Student: Look, a well known financial expert placed what could potentially be a hundred dollar bill on the ground, other well-known financial experts just leave it there!

▲

a day ago | parent | prev [-]

[deleted]

▲

mapmeld a day ago | parent | prev [-]

Well we have the idea and the next best thing to official code, but if this was a big revelation where are all of the Titan models? If this were public, I think we'd have a few attempts at variants (all of the Mamba SSMs, etc.) and get a better sense if this is valuable or not.