Remix.run Logo
Remix clone Hacker News
new | show | ask | jobsGithub
▲ Symbiote 2 hours ago

I have observed the same from Meta's crawler.

  User-agent: *
  Disallow: /
on e.g. our preproduction site, Meta is the only big-tech crawler that accesses it, at least with an honest user agent. (Meta also accesses disallowed paths on the production site.)