The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Moz Dupe content crawl anomaly

    Moz Dupe content crawl anomaly

    Other Research Tools
    3 2 208
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Dan-Lawrence
      Dan-Lawrence last edited by

      Hi

      Moz has completed a crawl for a site i'm working on which also has a development area (hence with lots of dupe content) on a sub domain (and this dev area hasn't been hidden from crawlers via password, robots, gwt etc etc).

      Moz dupe content report is not showing any of these urls though even though my campaign setting is on 'root' domain so i would have thought report should be listing the subdomain urls as dupe content (because they are dupe content).

      Any ideas ?

      Cheers

      Dan

      1 Reply Last reply Reply Quote 0
      • PaddyDisplays
        PaddyDisplays last edited by

        if there are no links from the main site (or root domain) to the development site, then there is no way to find the sub domain.

        Even if it was on the main domain in a sub-folder, but had no internal links to it, the Moz bot could not find it

        1 Reply Last reply Reply Quote 1
        • Dan-Lawrence
          Dan-Lawrence last edited by

          thanks Paddy !

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Need help fixing a duplicate content issue for my website. The moz crawl is show OMG my website with https:// and https://www. But I have never used the url https:// so I don’t understand why moz is showing this
            RossKernez
            RossKernez
            0
            4
            58

          • Why is on-demand crawl reporting numbers that are very different than the regualr site crawl by Moz?
            ctripp1010
            ctripp1010
            0
            3
            43

          • Alternative to Moz Content?
            ronell-smith
            ronell-smith
            1
            7
            172

          • I update content and then craw but the MOZ spider still shows old content. Do I need to update something else?
            DennisSeymour
            DennisSeymour
            0
            4
            126

          • Moz Crawl Test Trying to Crawl Contact Form Submit Button Location?
            Funk-Creative-Media
            Funk-Creative-Media
            0
            3
            157

          • Confusing Moz Crawl?
            Rebeca1
            Rebeca1
            0
            3
            128

          • How do I get Moz to crawl my site?
            Modi
            Modi
            0
            3
            1.8k

          • Rel Canonical and Moz Crawl
            Chris.Menke
            Chris.Menke
            0
            6
            253

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy