It’s certainly true that an adult would tend to have more additional knowledge and be better able to understand a lot of writing, but if you avoid exposing kids to anything they don’t have total understanding of the context of, you won’t really be able to teach them anything. Discussing books can help provide some of that context they’re missing. It’s probably fine to teach arithmetic before algebraic number theory too.