Is Moz crawler bot lazy?
-
This post is deleted! -
According to Imperva Incapsula Bot Traffic Report Ahrefs bot is the fastest commercial crawler which means it discovers links faster than other crawlers. I would not say that Moz bot is lazy, it just crawls the web at a slower rate.
-
If it's that slow, it probability isn't worth the monthly fees I'm gonna pay. Bye Mr. Moz
-
Hi - Thanks for posting,
The report linked above is from 2016, which was prior to us completely rebuilding our link index crawler that was launched in 2018 https://moz.com/blog/link-explorer.
After being found, newly discovered links have the ability to be populated into our index in about 3 days. However, there are a lot of factors that can affect our ability to find and index links to your site. It's important to note that we are always adding new data to our index, but it may take some time for us to discover backlinks to your site based on factors like crawlability of the referring pages, quality of the links, and the referring pages, and more.
If you are not seeing links that you know you have, you can add them to Link Tracking Lists. Once you add a link to your tracking lists we will add that page to be crawled. As long as it is accessible to our crawler, you should see the link in our index as soon as we can index those pages.
Lastly, I have a great guide here with some things to check around why we may not have found your links yet: https://moz.com/help/link-explorer/link-building/moz-isnt-finding-your-links
Best
-
I have added to the Link tracking and it's been already two weeks but Moz is still not indexing these backlink. Heck, even wikipedia backlink isn't indexed.
All these backlinks are already indexed by Google and Ahrefs.
-
Its totally possible that other crawlers can index something, that we are blocked from indexing. I would suggest reaching out to the Support Team with some specific examples so we can see whats going on.
Best,