| ▲ | kasey_junk 2 hours ago | |
In testing for my workflows copilot significantly underperforms the SOTA agents, even when using the exact same models. It's not particularly close either. This has lead to 2 classes of devs at my company a) AI hesitant, who for many copilot is their only interaction, having their worst fears confirmed about how bad AI is. b) AI enthusiasts who are irritated by dealing with management that don't know the difference pushing back on their asks for access to SOTA agents. If I were the frontier labs, and wasn't billions of dollars beholden to Microsoft, I'd cut Copilot off. It poisons the well for adoption of their other systems. I don't deal with the other copilots besides the coding agent variants but I hear similar things about the business application variants. Microsofts AI reputation is in the toilet right now, I'm not sure if its understood how bad it really is within the org. | ||