https://blog.alexewerlof.com/robots.txt

Gives a small hint. It should be respected and effective.