| ▲ | freakynit an hour ago | |
Regulation should require model auditing, which should be fully automated, free(or extremely affordable), and time-bound, irrespective of who the client is. What Altman, Dario and other such folks are trying to do is put a price on getting the model audited, by playing on these: price, timelines, red-tape. Maybe a test-suite, kept continuously updated, similar to those benchmarks we already have for measuring the intelligence of these models. Like arc-agi, or terminal bench, or more. | ||