That's the smartest thing I saw in quite a while
Does it work though? The big LLM crawlers do not read llms.txt so will they read and follow the same instructions as HTML?
Someone has to have done or is doing an experiment with this right? I also think that if it was an actual profitable thing then we would know about it pretty quickly. It would pop up everywhere
Apparently new checks in Chrome Lighthouse are checking for the existence of the file.
https://searchengineland.com/google-llms-txt-chrome-lighthou...
I have no idea, in theory it might catch some miss-configured agents off-guard