The LLMs are in fact quite expensive! We run dozen of LLM calls across thousands of products. That's thousands to tens of thousands of calls per search query. The idea is we've got to find the best & the cheapest, and I have spared no expense in doing so. (Plus we have GCP credits.)

Eventually products will overlap between search queries, so we can serve fast and low latency results that have been pre-processed by LLMs. That will be near zero cost. And of course LLM prices will continue to drop quickly.

We monetize via affiliate fees -- you buy something off that list, and we get 1-4% back at no cost to you.