▲ | fragmede 3 days ago | |
LLMs write python and typescript well, because of all the examples in their training data. But what if we made a new programming language whos goal was to be optimal for an LLM to generate it? Would it be closer to assembly? If we project that the future is vibe coded, and we scarcely look at the outputted code, testing, instead, that the output matches the input correctly, not looking at the code, what would that language look like? | ||
▲ | alankarmisra 3 days ago | parent | next [-] | |
They’d presumably do worse. LLMs have no intrinsic sense of programming logic. They are merely pattern matching against a large training set. If you invent a new language that doesn’t have sufficient training examples for a variety of coding tasks, and is syntactically very different from all the existing languages, the LLMs wouldn’t have enough training data and would do very badly. | ||
▲ | majormajor 3 days ago | parent | prev | next [-] | |
What is it that you think would make a certain non-Python language "more optimal" for an LLM? Is there something inherently LLM-friendly about certain language patterns or is "huge sets of training examples" and "a robust standard library" (the latter to conserve tokens/attention vs having to spit out super-verbose 20x longer assembly all day) all "optimality" means? | ||
▲ | metrix 3 days ago | parent | prev | next [-] | |
I have thought the same thing. How is it created? is it an idea by an LLM to make the language, or a dev to create a language designed for an llm. How do we get the LLM to gain knowledge on this new language that we have no example usage of? | ||
▲ | hoyo1s 3 days ago | parent | prev [-] | |
Strict type-checking and at least with some dependent type and inductive type |