Remix.run Logo
▲ xgk 2 hours ago

What makes EBM hard to train?

It took a long time (including the development of GPUs, then TPUs, not to mention domain-specific languages like JAX and PyTorch with associated compilers) and scale to train LLMs. EBMs have not yet seen this level of decades of 'full-stack' optimisation.