Have seen similar issues with understanding things that are somewhat orthogonal concerns to the main thing that is being worked on.

My guess is that context = main thing + somewhat unrelated thing is too big a space for the models to perform well at this point in time.

The practical solution is to remove the need for the model to figure it out each time and instead explicitly tell it about as much as possible before hand in CLAUDE.md.