| ▲ | ofa0e 5 hours ago |
| Your benchmarks should not involve IP. |
|
| ▲ | sowbug 4 hours ago | parent | next [-] |
| The only intellectual property here would be trademark. No copyright, no patent, no trade secret. Unless someone wants to market the test results as a genuine Pac-Man-branded product, or otherwise dilute that brand, there's nothing should-y about it. |
| |
| ▲ | bongodongobob 3 hours ago | parent [-] | | It's not an ethics thing. It's a guardrails thing. | | |
| ▲ | sowbug 2 hours ago | parent [-] | | That's a valid point, though an average LLM would certainly understand the difference between trademark and other forms of IP. I was responding to the earlier comment, whose author later clarified that it represented an ethical stance ("stealing the hard work of some honest, human souls"). |
|
|
|
| ▲ | ComplexSystems 5 hours ago | parent | prev [-] |
| Why? This seems like a reasonable task to benchmark on. |
| |
| ▲ | adastra22 5 hours ago | parent | next [-] | | Because you hit guard rails. | |
| ▲ | ofa0e 5 hours ago | parent | prev [-] | | Sure, reasonable to benchmark on if your goal is to find out which companies are the best at stealing the hard work of some honest, human souls. | | |
|
