Could be camera and canvas to CAD - be more apt for your use case? Something akin to minority report + AI?

Asking seriously.

Context: Have some overlapping interest in the space because I am prototyping a camera based edge device that allows for AR/AI interactions.

The problem is more so that I think I'd need a brain-machine interface to get what I want. If I'm brainstorming a way to solve a problem mechanically, some if it is drawing but honestly a lot of it is just imagining it in my head. From there I go straight from imagination or sketches to CAD, which is why text-to-CAD or drawing-to-CAD generally doesn't work, the act of making the CAD file is how you learn and figure out how to solve the problem better once you see it all in 3D space

We have a little experimental tldraw style canvas integrated in the extension we've been playing with!