| ▲ | rvz 11 hours ago | |
> > Be sure to protect friendly bots and search engines from Miasma in your robots.txt! Can't the LLMs just ignore or spoof their user agents anyway? | ||
| ▲ | phoronixrly 10 hours ago | parent [-] | |
Well-behaved agents will obey robots.txt and not fall into the trap. | ||