| ▲ | Capricorn2481 3 hours ago |
| > At 1t/s it's still faster than humans for a lot of tasks Which tasks? I think you're underestimating how token hungry current proposed workflows are. |
|
| ▲ | redox99 3 hours ago | parent | next [-] |
| Anything you do right now? A typical 10 minute prompt "simply" becomes about 7 hours long. (40t/s vs 1t/s). |
| |
| ▲ | Capricorn2481 3 hours ago | parent [-] | | I don't really do anything at my job that could be done in a single prompt, and certainly not something that would take me 7 hours. A 7 hour task would take multiple iterations with how LLMs are right now. You said it would do overnight what would take a human half a week, so I'm curious what tasks you are doing where AI is 3x faster than you even at 1t/s | | |
| ▲ | redox99 3 hours ago | parent [-] | | Your prompts are probably very underspecified then. Frontier models one shot the majority of my prompts. UI is kind of the exception, there I do have to ask for a lot of tweaks. | | |
| ▲ | Capricorn2481 3 hours ago | parent [-] | | Maybe. Do you have an example of a prompt you've done recently? I don't think it's valuable at all to try and craft a specific prompt to "one-shot" a task, I'm way faster just doing small asks and guiding it. At 1t/s, how would you even know your prompt was insufficient? It would take you 7 hours to see it. | | |
| ▲ | redox99 3 hours ago | parent [-] | | Stuff along the lines of implement controller service and tests for the following endpoints: - list of many endpoints with the JSON they receive and return and description of what they need to achieve Stuff you could probably do in a single work day if you lock in and enter flow state, but in a typical job takes like half a week. And the vast majority of times the AI one shots it with no bugs, where I would have copy paste errors or dumb stuff I'd need to fix before it's shippable. | | |
|
|
|
|
|
| ▲ | coldtea 3 hours ago | parent | prev [-] |
| Doesn't matter which task. Compare it with about 40-50t/s an LLM oneshots with, and it, and whatever task now takes X time, takes X * 40-50 with this. |
