> we figured out how to train Dessa on only one NVIDIA GB200 NVL72.

This is the crazy part. It seems pretty smart, and LLMs require 1000x more compute to train. Can this kind of efficiency somehow be achieved with text too?

Not if you want the same model that debugs your C++ to also be able to sort objects by shape and generate a description of a video and pick out a good birthday gift for your cousin