| ▲ | Three-LLM: Three.js-based WebGPU LLM inference engine(three-llm.ben3d.ca) |
| 12 points by bhouston 2 days ago | 5 comments |
| |
|
| ▲ | esperent 2 days ago | parent | next [-] |
| What makes a 3d graphics rendering engine a good fit for llm inference? |
| |
| ▲ | bhouston 2 days ago | parent [-] | | ThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development: https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan... | | |
| ▲ | anematode 2 days ago | parent [-] | | That makes very little sense when you can just use WebGPU and have fine-grained control... for something like LLM inference, having this kind of abstraction seems like quite a hindrance | | |
| ▲ | bhouston 2 days ago | parent [-] | | Okay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient. |
|
|
|
|
| ▲ | jauntywundrkind 2 days ago | parent | prev [-] |
| can someone please go ham on a newer three.js, preferably with a lot of A-frame built in, for the modern era, that is also webgpu native? pretty please? |
