Remix.run Logo
yakkomajuri 3 hours ago

hey, author (not op) here. we do do semantic chunking! I think maybe I gave the impression that we don't because of the mention of aggregating context but I tested this with questions that would require aggregating context from 15+ documents (meaning 2x that in chunks), hence the comment in the post!

mips_avatar 3 hours ago | parent [-]

Ah so you’re generating context from multiple docs for your chunks? How do you decide which docs get aggregated?