Remix.run Logo
wilg 3 hours ago

robots.txt bro https://developers.openai.com/api/docs/bots/

tomalbrc 2 hours ago | parent [-]

"bro": https://www.businessinsider.com/openai-anthropic-ai-ignore-r...

wilg 22 minutes ago | parent [-]

should be pretty easy to test and not rely on an anonymous source from a weird analytics company via business insider. are these bots actually from openai or are they just using their user agent? are they coming from openai ip ranges? etc. https://openai.com/gptbot.json