| ▲ | jamiequint 5 hours ago | |
This is cool, like qmd as a service with real-time integrations where it matters? How do you handle more structured data like csv/xlsx/json? Would be cool if it were possible to auto-process links to markdown (e.g. youtube, podcast, arbitrary websites, etc) a la https://github.com/steipete/summarize (which can pull full text in addition to summarizing). | ||
| ▲ | CMLewis 5 hours ago | parent [-] | |
Thanks, we're just starting to optimize more for the semi-structured data. So far, we've been parsing tables into Markdown and running them through the contextualized embedding model with no overlap, taking advantage of how it strings together chunks. This isn't great for big files so we're exploring agentic exploration (slow but good for more structured numerical data) and automated graph creation (promising for more relational data). Love the auto-process markdown idea, we'll add it to our roadmap :D | ||