Remix.run Logo
▲ theplumber 2 hours ago

In my experience Google models have always been mediocre at best and dangerous to use at worst but I must admit that I didn’t try the latest Aragon/carbon crop.

I learned not to put too much trust into benchmarks. The best benchmark is to use the model on a codebase you know well.