Personally I feel they are overkill.

For example I’m using duckDB as a vector store for similarity search and RAG. It works really well.

https://github.com/patricktrainer/duckdb-embedding-search