Show HN: Crawlie – Free open-source SEO audit tool for humans and agents

With AI, it's faster than ever to ship a marketing site... but most of what gets generated is slop that was never built to be found. Plus the tools meant to catch that fall short: most SEO auditors cost money, don't play nicely with your agents, or tell you what's wrong without telling you how to actually rank for SEO and GEO (Generative Engine Optimization: being cited by AI search like ChatGPT, Perplexity, and Google AI Overviews).

crawlie fixes that! It's 100% free, it's local-first, it's agent-native (MCP baked in!), and every issue it finds comes with why it matters and how to fix it.

▲

mathisdev7 2 days ago | parent | next [-]

Nice, thanks!

edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie

	▲	seandotexe 2 days ago \| parent [-]
		Thank you for catching! The docs were a bit too eager on the package simplifying I worked on (oops!).. "npm i -g crawlie" is now correct we're shipping fast, will break less things now though I promise ;)

▲

SeriousM 2 days ago | parent | prev | next [-]

That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.

	▲	seandotexe 2 days ago \| parent [-]
		Thank you!! Lots more to come Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.

▲

davekilleen 2 days ago | parent | prev [-]

Nice

	▲	seandotexe 2 days ago \| parent [-]
		Appreciate it Dave! Excited for you to try it out