Spider Simulator
See a page exactly as a search engine crawler sees it: tags, headings, links and text.
Website Checker Tools
About the Spider Simulator
The Spider Simulator shows a page the way a simple search crawler reads it: stripped of design, leaving the title, description, robots tag, canonical, headings, links and visible text. It also reports internal, external and nofollow links, images missing alt text, and whether structured data is present.
Use it to confirm that your important content is in the HTML. If your main text is missing here, it may be added by JavaScript. Google can run scripts, but it may do so later, and other crawlers may not do it at all.
The results are based on your page's HTML, not a copy of Googlebot. To see exactly what Google rendered, use URL Inspection in Google Search Console. The list of discovered links shows the first 40, which helps you check how a crawler would move through your site.
How to use this tool
- 1Enter the page address.
- 2Press Crawl Page.
- 3Check the title, description, robots and canonical values.
- 4Read the headings and visible text to confirm that your content is there.
Best-practice tips
- Your main topic should be in the H1 and early in the text.
- Links should have descriptive anchor text, not "click here".
- Make sure the robots value does not say noindex by mistake.
Answers
Spider Simulator FAQs
No. It reads the HTML. Google can also run JavaScript, so its view may contain more.
It is probably added by scripts after loading. Consider putting your main content in the HTML.
The link asks search engines not to treat it as a recommendation.
Related tools
Continue with these related website checker tools.