They do, in the paper they mention they evaluate the LLM without tools