| ▲ | xgk 2 hours ago | |
What makes EBM hard to train? It took a long time (including the development of GPUs, then TPUs, not to mention domain-specific languages like JAX and PyTorch with associated compilers) and scale to train LLMs. EBMs have not yet seen this level of decades of 'full-stack' optimisation. | ||