The cost you pay is in additional reasoning the SLMs have to do. As I write elsewhere, LLM "remembers" that "Socrates is mortal", or other commonly useful deduction. SLM might need to derive it first by reasoning from the DB, which slows it down. (Or worse, it might miss the correct reasoning because it's just too much side quests to follow.) But the advantage is flexibility.