The Crawlability Test tool allows you to test specific pages on your website to see if they can be crawled and indexed by the various search engines. It looks at rules defined in meta tags and the website’s robots.txt file.
