Remix.run Logo
Grimblewald 2 days ago

Not really. Basic stuff, sure, ai nails. However much stuff thats interesting or useful AI sucks at. Try getting it to replicate the performance of microsoft research's image composite editor. The research/knowledge is in public domain (brown et al paper on panoramic stitching via ransac/sift, gain correction etc) and yet ai suck at it. A task that takes ICE less than a minute can take AI version 30 minutes+ and produces worse results. After loads of hand holding you can kind of get it to be close to ICE performance, but never really. Every new model that comes out, that's one of my personal tests among a battery of others. Ironically llms seem to be getting worse at many of these tasks, not better. Need some webapp with a database and a sleek looking ui? AI has your back (kind of, still sloppy or dangerously unsafe half the time) need some simple get data plot data thing? Ai can do that.

however, actually interesting useful things it tends to fail at, and these can be small reasonably sized projects.

worse still, AI models seem to be optimizing for how many tokens they can make you burn before you give up, rather than minimizing turns required to have a finished product, I say that because each new model that comes out, it needs more turns of coaxing and prodding to get to a functional state.