I am pretty sure llamacpp have their own benchmarking binary that you can use.