The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools

    Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools

    Moz Tools
    3 2 354
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RichSteel
      RichSteel last edited by

      Hi Guys,

      We're new here and I couldn't find the answer to my question.  Here it goes:

      We had SEOMoz's Roger Crawl all of our pages and he came up with quite a few erros (Duplicate Content, Duplicate Page Titles, Long URL's).

      Per our CTO and using our Google Webmaster Tools, we informed Google not to index those Duplicate Content Pages.  For our Long URL Errors, they are redirected to SEF URL's.

      What we would like to know is if Roger is able to know that we have instructed Google to not index these pages.  My concern is

      1. Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools

      2. Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?

      Thanks so much,

      e

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        In order to answer your questions, we need to understand exactly how you "instructed Google".

        If you went into Google Webmaster Tools and changed settings such as parameters of URLs, then only Google will know about those changes. Roger wont know and neither will Bing or any other crawler.

        Whenever possible I recommend making the proper adjustments on your site so all crawlers know and understand how to crawl your website.

        **1) Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools  **

        Yes. First of all, Bing + Yahoo = 30% of the search market and they will experience the same trouble as Roger. Second, by informing Google directly you are making changes in a way that make it impossible for tools such as Roger to provide you with actionable data.

        2) Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?

        Not that I am aware of. I wish Roger made better friends with Googlebot and could learn all the personal settings, but that was not possible the last time I checked.

        RichSteel 1 Reply Last reply Reply Quote 2
        • RichSteel
          RichSteel @RyanKent last edited by

          Thanks Kent!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Duplicate content flagged by Moz that's not actually duplicate content at all
            Caro-O
            Caro-O
            1
            4
            89

          • Duplicate content in crawl despite canonical
            ClaireH-184886
            ClaireH-184886
            0
            3
            144

          • Does SEOmoz have a Keyword Research tool similar to, say, the Google AdWords tool or the WebCEO Keyword Research Tool? And where might that be? (Sorry, I'm very new to SEOmoz Pro.)
            Mike.Goracke
            Mike.Goracke
            0
            2
            265

          • Why does SEOMoz think I have duplicate content?
            jsillay
            jsillay
            0
            3
            297

          • It would be Great if their were further integrations with Google Webmaster Tools
            Cyrus-Shepard
            Cyrus-Shepard
            0
            2
            415

          • Could SEOMOZ make a tool thats connected directly to Webmaster Tools?
            Grumpy_Carl
            Grumpy_Carl
            0
            3
            356

          • Crawl test tool from SEOmoz - which URLs does it actually crawl?
            ShaMenz
            ShaMenz
            0
            4
            787

          • SEOmoz vs Google Webmaster Tools on incoming links
            bvalentine
            bvalentine
            0
            5
            806

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy