Remix.run Logo
latenightcoding 12 hours ago

What I wonder is: are current LLMs even good for the type of work he does: novel, low-level, extremely performant

vbezhenar 2 hours ago | parent | next [-]

I'm writing C for microcontrollers and ChatGPT is very good at it. I don't let it write any code (because that's the fun part, why would I), but I discuss with it a lot, asking questions, asking to review my code and he does good. I also love to use it to explain assembly.

bionsystem an hour ago | parent [-]

It's also the best way to use llms in my opinion, for idea generation and snippets, and then do the thing "manually". Much better mastery of the code, no endless loop of "this creates that bug, fix it", and it comes up with plenty of feedback and gotchas when used this way.

vitaminCPP 10 hours ago | parent | prev | next [-]

As a professional C programmer, the answer seems to be no; they are not good enough.

mhh__ 4 hours ago | parent | prev | next [-]

This is a funny one because on the one hand the answer is obviously no, it's very fiddly stuff that requires a lot of umming and ahhing, but then weirdly they can be absurdly good in these kinds of highly technical domains precisely because they are often simple enough to pose to the LLM that any help it can give is actually applicable immediately whereas in a comparatively boring/trivial enterprise application there is a vast amount of external context to grapple with.

rjzzleep 7 hours ago | parent | prev | next [-]

From my experience, it's just good enough to give you a code overview of a codebase you don't know and give you enough implementation suggests to work from there.

wolttam 11 hours ago | parent | prev | next [-]

If Fabrice explained what he wanted, I expect the LLM would respond in kind.

vasco 10 hours ago | parent [-]

If Fabrice explained what he wanted the LLM would say it's not possible.

When the coding assistant LLMs load for a while it's because they are sending Fabrice an email and he corrects it and replies synchronously.

koakuma-chan 12 hours ago | parent | prev | next [-]

No

slekker 11 hours ago | parent | prev [-]

I doubt it, although LLMs seem to do well on low-level (ASM level instructions).