Remix.run Logo
pa7ch 5 hours ago

What has that got to do with blocking AI crawlers?

ninjagoo 5 hours ago | parent [-]

If it's publicly funded, why shouldn't AI crawlers have access to that data? Presumably those creating the AI crawlers paid taxes that paid for the science.

JumpCrisscross 4 hours ago | parent [-]

> If it's publicly funded, why shouldn't AI crawlers have access to that data?

Becase it costs money to serve them the content.

wyre 3 hours ago | parent [-]

If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI?

Is the answer regulate AI? Yes.

JumpCrisscross 2 hours ago | parent [-]

> If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI?

Because when you build it you aren't, presumably, polling their servers every fifteen minutes for the entire corpus. AI scrapers are currently incredibly impolite.