Seems that you're looking for a RAG System, and you may have a try RAGFlow

Interesting, I had found Paperless:

https://github.com/icereed/paperless-gpt

https://docs.paperless-ngx.com/#features

These options seem far from... user friendly. Another concern is resource usage, I wonder how low LLMs will go (especially as far RAM and GPU requirements are concerned).