Free website tools

Check how any site talks to search engines and AI crawlers. Free, no signup, and every result shows the exact line or file it came from.

• AI Crawler & ai.txt CheckerSee which AI crawlers (GPTBot, ClaudeBot, Google-Extended, …) your robots.txt lets in, and what your ai.txt declares.
• llms.txt CheckerValidate a site’s llms.txt against the format, find llms-full.txt, and test the links inside.
• robots.txt CheckerFind syntax errors, accidental “block everything” rules, and whether search engines can reach your site.
• Sitemap CheckerFind and validate an XML sitemap: size limits, dates, robots.txt listing, and a sample of broken or redirecting URLs.
• AI Website DetectorWas a site built with an AI website builder or AI coding tool? Our main tool.