Remix.run Logo
▲ mocmoc 3 hours ago

I've spent a year on this. EBMs while ... how to say it, they are impressive validators , it's insanely hard to train them. They are very niche specific. While LLMs , being not right all the time and clumsy and so on, they help the people to get the job done at the end.

EBM sudoku is not that hard in a small scale, and Logical Intelligence sudoku solver doesn't scale , if I'm wrong , I want to see them offering as big of a sudoku as you want.

also, after months and months training EBMs , you come to realize... it's really worth it?

▲xgk 2 hours ago | parent | next [-]

What makes EBM hard to train?

It took a long time (including the development of GPUs, then TPUs, not to mention domain-specific languages like JAX and PyTorch with associated compilers) and scale to train LLMs. EBMs have not yet seen this level of decades of 'full-stack' optimisation.

▲m3kw9 an hour ago | parent | prev [-]

is it good for local llm's where you do a very specific task like voice removal?