▲ | gcanyon 3 days ago | |
> It has an effective context window of 2M tokens, and can index projects of 20M tokens and beyond using tree-sitter project maps (30+ languages are supported). It can effectively find relevant context in massive million-line projects like SQLite, Redis, and Git. Does this possibly have non-coding-related utility for general reasoning about large volumes of text? | ||
▲ | danenania 3 days ago | parent [-] | |
The project map supports markdown files (and html), so you could definitely use it to explore docs, notes, etc. if they're all in markdown/html. Plaintext files aren't currently mapped though, so just the file name would be used to determine whether to load those. |