The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Moz Dupe content crawl anomaly

    Moz Dupe content crawl anomaly

    Other Research Tools
    3 2 208
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Dan-Lawrence
      Dan-Lawrence last edited by

      Hi

      Moz has completed a crawl for a site i'm working on which also has a development area (hence with lots of dupe content) on a sub domain (and this dev area hasn't been hidden from crawlers via password, robots, gwt etc etc).

      Moz dupe content report is not showing any of these urls though even though my campaign setting is on 'root' domain so i would have thought report should be listing the subdomain urls as dupe content (because they are dupe content).

      Any ideas ?

      Cheers

      Dan

      1 Reply Last reply Reply Quote 0
      • PaddyDisplays
        PaddyDisplays last edited by

        if there are no links from the main site (or root domain) to the development site, then there is no way to find the sub domain.

        Even if it was on the main domain in a sub-folder, but had no internal links to it, the Moz bot could not find it

        1 Reply Last reply Reply Quote 1
        • Dan-Lawrence
          Dan-Lawrence last edited by

          thanks Paddy !

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Moz is only crawling 2 pages
            mvnmarketing
            mvnmarketing
            0
            5
            91

          • My page cant be crawled by MOZ
            zita.vn
            zita.vn
            0
            8
            109

          • Canonical in Moz crawl report
            Brando16
            Brando16
            0
            3
            338

          • I update content and then craw but the MOZ spider still shows old content. Do I need to update something else?
            DennisSeymour
            DennisSeymour
            0
            4
            126

          • Moz Crawl Showing Duplicate Content But It's Not?!
            dan.lecocq
            dan.lecocq
            0
            3
            175

          • Confusing Moz Crawl?
            Rebeca1
            Rebeca1
            0
            3
            128

          • How do you stop Moz crawling a page?
            signcreator
            signcreator
            0
            6
            2.5k

          • How do I get Moz to crawl my site?
            Modi
            Modi
            0
            3
            1.8k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy