| ▲ | Compiling models to megakernels(blog.luminal.com) |
| 15 points by jafioti a day ago | 5 comments |
| |
|
| ▲ | measurablefunc an hour ago | parent [-] |
| There are only 4 optimizations in computer science: inlining, partial evaluation, dead code elimination, & caching. It looks like AI researchers just discovered inlining & they already knew about caching so eventually they'll get to partial evaluation & dead code elimination. |
| |
| ▲ | fragmede an hour ago | parent | next [-] | | Dead code elimination is already a technique in AI when someone takes an MoE model and removes an unused "E" from it. | |
| ▲ | mxkopy 41 minutes ago | parent | prev [-] | | AI actually has some optimizations unique to the field. You can in fact optimize a model to make it work; not a lot of other disciplines put as much emphasis on this as AI | | |
|
