Aren’t those “record it all” applications implemented as a RAG and injected into the context based on embedding similarity?
Obviously you’re not going to always inject everything into the context window.