Spider Simulator

See a page exactly as a search engine crawler sees it: tags, headings, links and text.

Try:

Website Checker Tools

About the Spider Simulator

The Spider Simulator shows a page the way a simple search crawler reads it: stripped of design, leaving the title, description, robots tag, canonical, headings, links and visible text. It also reports internal, external and nofollow links, images missing alt text, and whether structured data is present.

Use it to confirm that your important content is in the HTML. If your main text is missing here, it may be added by JavaScript. Google can run scripts, but it may do so later, and other crawlers may not do it at all.

The results are based on your page's HTML, not a copy of Googlebot. To see exactly what Google rendered, use URL Inspection in Google Search Console. The list of discovered links shows the first 40, which helps you check how a crawler would move through your site.

How to use this tool

  1. 1Enter the page address.
  2. 2Press Crawl Page.
  3. 3Check the title, description, robots and canonical values.
  4. 4Read the headings and visible text to confirm that your content is there.

Best-practice tips

  • Your main topic should be in the H1 and early in the text.
  • Links should have descriptive anchor text, not "click here".
  • Make sure the robots value does not say noindex by mistake.

Answers

Spider Simulator FAQs

No. It reads the HTML. Google can also run JavaScript, so its view may contain more.

Related tools

Continue with these related website checker tools.