| ▲ | skybrian 2 hours ago | |
If we get low enough latency, there's no reason to multitask. You can ask it to do one thing at a time and immediately see what it did. That's a nice way to work! This is normal interactive UI for tasks that aren't compute-intensive. Programs spend most of their time idle, waiting for us to click a button. We shouldn't be waiting for them or spinning more plates to keep them busy. However, a faster llm isn't enough. You also need fast compiles and fast tests. | ||