Tools
r/sideprojects
Free scanner checks whether a site is invisible to AI crawlers
TLDR
A free tool scores any URL on 8 AI-relevance signals and generates a ready /llms.txt file. The four pillars: clean HTML, JSON-LD structured data, a robots.txt that permits AI bots, and llms.txt.