| ▲ | dist-epoch 2 hours ago | |
Each letter has it's own token. LLMs can invent new words if they want to, just like humans do. All the fancy words we use today in science did not exist even 100 years ago. And that didn't stop us. | ||
| ▲ | faeyanpiraat 2 hours ago | parent [-] | |
How would this word inventing thing work? And how useful would it be? Can we make a POC around this? | ||