My website doesn't get crawled

The crawlers follow the links to get to the next pages.

This is one of the reasons why the SEO people work with menus and often create top and bottom menu.

Guideline states: 'Ensure that all pages on the site can be reached by a link from another findable page.'

After that you might want to:

  1. create a sitemap
  2. create your robots.txt

Thirdly, there might be a plugin enabled at your side that prohibits them to do this. Please check your plugins.

  • website, crawl, crawler
  • 3 Users Found This Useful
Was this answer helpful?

Related Articles

The ads company cant craw my website to see the ads on it cause they are getting IP Blocks

If there are IP blocks - check the plugins that block spam like Sucuri and others. Also, please...