Crawler Accessibilit
-
In Insights section of MOZ campaign, I'm seeing this: https://imgur.com/Gu2K9dz
Here are the contents of robots.txt:
User-agent: *
Disallow: /wp-admin/Sitemap: http://website.com.com/sitemap_index.xml
Can you please let me know what is wrong here?
-
Hi there!
Thanks so much for the great question! The data that populates in the homepage insights module in your Campaign is pulled when your Campaign is initially created and we do not update that info with each crawl like your other data. If something has changed since the Campaign was initially created, that module will not reflect the change. Sorry for that confusion!
If you'd like me to look into this further for your specific Campaign, I would be happy to do so! I would just need you to send an email on over to help@moz.com with the Campaign name so we can investigate.
I hope this helps!