Remix.run Logo
pton_xd 6 hours ago

> My model doesn't need to know a single line of python.

If I had to guess, the weights necessary to encode "how to program" are much larger than the final step of "output python."

mohamedkoubaa 3 hours ago | parent | next [-]

Sure but I bet this doesn't translate as well in this way to things like Erlang

mathisfun123 6 hours ago | parent | prev | next [-]

<THAT'S A BINGO>

ie what everyone asking for this fails to immediately realize.

card_zero 5 hours ago | parent [-]

You're a bingo. It's obvious that a model could know no Python, since Python could not exist in the world in the first place.

kennywinker 5 hours ago | parent [-]

the best llm for coding is the one that knows every programming language imagined by a caffeine-fuelled comp-sci student at 2am but never built.

Retro_Dev 4 hours ago | parent [-]

if neuralink ever becomes a thing, thoughts about programming might be stolen for LLM training data lol

echelon 6 hours ago | parent | prev [-]

But the understanding of the language library ecosystem, or even better, your codebase, could let it execute faster and with less context usage.

exe34 5 hours ago | parent [-]

That's the bit I feel you can do with ragging - keep a large library of well described solutions and then find what you need from it at runtime.