| ▲ | owenpalmer 2 days ago | |
While spatial intelligence is certainly a major limitation of current AI systems, I have been able to get LLMs to do quite impressive things. Here's an on the fly video I made (no retakes) of Claude generating a Godot scene file. | ||
| ▲ | AStrangeMorrow 2 days ago | parent [-] | |
Yeah funnily I did a project where we had an LLM based interface to in house 3D parametric modeling system and it did fairly well. However I’ve been trying to use LLM, both as orchestrators and in other cases to write code for 2D optimization problems with many spatial relationships and it has done terribly. I have talking it can generate 1000s of lines over many rounds of prompting/iteration that solve maybe 30% of the problem (and the 30% very easy cases) while completely messing up the rest. When doing that code myself, in less than 1000 lines, the “30% part” was maybe 3% of the total code. Even when basically providing pseudo code to solve specific part of the problem chances are these LLM solutions would also have many blind spots or issues. The thing is, that is a 2D problem for which there basically no ressources about online, and all the slightly similar problems all have careful handcrafted specialized solutions. So I think it has no good frame of reference how to solve the problem | ||