Those indexes cost an incredible amount of money to build, maintain and keep improving. It’s worth it for these orgs as these are considered a competitive edge and the “secret sauce” of these orgs.

I find it hard to believe the same amount of investment will be made into a decentralized web index, precisely for the reason that it cannot be monetized.