Remix.run Logo
vkou 5 hours ago

> Hey! I'm Nick, and I work on Integrity at OpenAI. These checks are part of how we protect our first-party products from abuse like bots, scraping, fraud, and other attempts to misuse the platform.

How can first-party products protect themselves from abuse by OpenAI's bots and scraping?

mystraline 4 hours ago | parent [-]

This is a completely in-scope question.

How do we defend against your scraping, OpenAI?

I dont want any of my content scraped or seen by you all. Frankly, fuck you all for thinking my content is owned by you.

wilg 3 hours ago | parent [-]

robots.txt bro https://developers.openai.com/api/docs/bots/

tomalbrc 2 hours ago | parent [-]

"bro": https://www.businessinsider.com/openai-anthropic-ai-ignore-r...

wilg 31 minutes ago | parent [-]

should be pretty easy to test and not rely on an anonymous source from a weird analytics company via business insider. are these bots actually from openai or are they just using their user agent? are they coming from openai ip ranges? etc. https://openai.com/gptbot.json