There is no reason to do it on a CPU instead of a GPU. Anyway, a vector database would be a better solution, although not without downsides.