> Anyways, all this vector stuff is going to fade away as context windows get larger (already started over the past 8 months or so).

We're searching across millions of documents, so i doubt it