| ▲ | yakkomajuri 3 hours ago | |
hey, author (not op) here. we do do semantic chunking! I think maybe I gave the impression that we don't because of the mention of aggregating context but I tested this with questions that would require aggregating context from 15+ documents (meaning 2x that in chunks), hence the comment in the post! | ||
| ▲ | mips_avatar 3 hours ago | parent [-] | |
Ah so you’re generating context from multiple docs for your chunks? How do you decide which docs get aggregated? | ||