| ▲ | matt_heimer 2 hours ago | |
Sure, depends on how accessibly to people you want it to be. Most legit search engines are going to honor robots.txt and you can disallow access. Next level would be using something like rate limiting controls and/or Cloudflare's bot fight mode to start blocking the bad bots. You start to annoy some people here. Next would be putting the content behind some form of auth. | ||