▲ | MattDaEskimo 5 days ago | ||||||||||||||||
Very neat in theory but I'm failing to find any technical details. Which layer is the automation happening? Inside using Dev tools? Multiple? What is the self-healing mechanic? I'm guessing invoking an LLM to find what happened and fix it? I guess what I'm wondering is. Is this some sort of hybrid between computer use and Dev tools usage? | |||||||||||||||||
▲ | jonasnelle 5 days ago | parent [-] | ||||||||||||||||
Autotab is definitely a hybrid approach, because when it comes to deciding where on the page to take an action, Autotab has to be fast & cheap (humans are both of those) while also being robust to changes. The solution we use is a "ladder of compute" where Autotab uses everything from really fast heuristics and local models up to the biggest frontier models, depending on how difficult the task is. For instance, if Autotab is trying to click the "submit" button on a sparse page that looks like previous versions of that page, that click might take a few hundred milliseconds. But if the page is very noisy, and Autotab has to scroll, and the button says "next" on it because the flow has an additional step added to it, Autotab will probably escalate to a bigger model to help it find the right answer with enough certainty to proceed. There is a certain cutoff in that hierarchy of compute that we decided to call "self-healing" because latency is high enough that we wanted to let users know it might take a bit longer for Autotab to proceed to the next step. | |||||||||||||||||
|