If you are benchmarking Java, there is Java Microbenchmark Harness (https://github.com/openjdk/jmh), which:

- Does several warm-up runs so the JIT-optimized code is benchmarked instead of the interpreted code/compilation.

- Create multiple forks of the JVM to eliminate JVM run variance.

- Provide utilities like `Blackhole` to prevent dead code elimination and `State` to do setup and prevent constant folding.