| ▲ | mschuster91 5 hours ago | |
> The public v0.3 source confirms the design > The hot runs are a result cache Funny, the report alleging cheating reeks of LLM usage just as much as the commit diff [1] of the next attempt: > # The standard ClickBench driver over the step scripts in this directory; ./install fetches the dataset. [1] https://github.com/ClickHouse/ClickBench/pull/2751/files | ||
| ▲ | spoiler 5 hours ago | parent | next [-] | |
We were the agents for the models all along, with our highly adaptive tools: versatile sausagey appendages and flapping fleshy orifices for interacting with the world | ||
| ▲ | axus 3 hours ago | parent | prev | next [-] | |
Would the AI have bothered to maximize the benchmark, if it hadn't been asked to? "LLM" isn't the problem. Asking an LLM to explain cheating is a good goal. Asking it to "Maximize the benchmarks" reeks. | ||
| ▲ | semiquaver 4 hours ago | parent | prev [-] | |
[dead] | ||