I'm experimenting to see if frontier LLMs can do practical CAD modeling. I'm starting with a single task: designing a wall mount for my bike pump in OpenSCAD or CadQuery (two code-based CAD systems).

None of the frontier LLMs (Gemini, ChatGPT, Claude) produce usable designs when just prompted with some photos of the pump and a written description of the mount. I'm now building a simulator in Mujoco that the LLMs can use to test and iterate on their designs to see if they can do better in this setting.

I'm hoping to make an interesting blog post of it and maybe end up with a usable wall mount design.