Amazing. I think this is an understudied areas. The big labs if anything are disincentivized to make efficient models as currently access to compute is one of their moats. That's not the same for Chinese labs, which is why you see groundbreaking efficiency work mostly coming from China.

Really happy to see a small shop like yours doing this sort of work!

▲

blueblazin 20 hours ago | parent [-]

That makes no sense. The big labs don’t reveal their efficiency research but that doesn’t mean they aren’t doing it. They can charge the same prices while making models more efficient internally and increase margins…

▲

darkwater 16 hours ago | parent [-]

I bet they do that as well but I also think that if they have to choose between inference speed or "intelligence" they would choose the latter.

▲

yorwba 13 hours ago | parent [-]

They don't have to choose, though, since they can release multiple models with different tradeoffs.

▲

darkwater 8 hours ago | parent [-]

This would imply they have infinite development capacity

	▲	yorwba 5 hours ago \| parent [-]
		Not infinite, just enough to make more than one model. OpenAI and Anthropic both have four different size categories...