The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Is seomoz rogerbot only crawling the subdomains by links or as well by id?

    Is seomoz rogerbot only crawling the subdomains by links or as well by id?

    Moz Tools
    2 2 302
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sauspiel
      sauspiel last edited by

      I´m new at seomoz and just set up a first campaign. After the first crawling i got quite a few 404 errors due to deleted (spammy) forum threads. I was sure there are no links to these deleted threads so my question is weather the seomoz rogerbot is only crawling my subdomains by links or as well by ids (the forum thread ids are serially numbered from 1 to x).

      If the rogerbot crawls as well serially numbered ids do i have to be concerned by the 404 error on behalf of the googlebot as well?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        Roger only crawls by links.

        When you are using forum software or a CMS it is very common for numerous links to be created by the software without your knowledge. If you examine your crawl reports, they will show you the URL of the page which provides the link which is generating the 404 error.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Crawl Diagnostics saids a page is linking but I can't find the link on the page.
          DirkC
          DirkC
          0
          4
          128

        • Why is Link Count smaller than Internal Links in Crawl Test report?
          iSTORM-New-Media
          iSTORM-New-Media
          0
          2
          383

        • What is the 'External Links' column referring to in the SEOMoz Crawl report?
          SEO-Enlighten
          SEO-Enlighten
          1
          5
          182

        • Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
          Johnny4B
          Johnny4B
          0
          4
          147

        • I am trying to find inbound links for one of my site urls. My question is does SEOMoz able to track all internal links as the Open Site Explorer shows 0 internal links?
          Jeepster
          Jeepster
          0
          4
          492

        • In my crawl diagnostics, there are links to duplicate content. How can I track down where these links originated in?
          kirklandsl
          kirklandsl
          0
          3
          307

        • How come there are no links to my website according to SEOmoz Competive domain analysis, while in google webmaster i do see links.?
          lavellester
          lavellester
          0
          2
          587

        • Only 1 page is being crawled by SEOmoz for the last 2 crawls
          KeriMorgret
          KeriMorgret
          0
          6
          863

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy