| ▲ | agar 4 hours ago | |
While this might be overly cynical, it's also a powerful validation of the exact feedback loop that you want to have in an organization. If what you say is true, then the next set of benchmarks will be written to illuminate the true reflection of real-world tasks. Then those get benchmaxxed so managers can show "numbers go up." Repeat enough times, and you get materially and genuinely improved products. The burden is on the press, outside researchers, and general tech industry to both write and care about the metrics that matter. | ||