The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Drupal infinite URL depth? SEOMOZ treating as duplicate content

    Drupal infinite URL depth? SEOMOZ treating as duplicate content

    Technical SEO Issues
    7 5 300
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dresults
      dresults last edited by

      I'm monitoring a subdirectory of my site on SEOMOZ but with catastrophic results. It's finding infinite duplicate content e.g.www.example.co.uk/product/samples/product/product/productand so on...

      The website is running on Drupal. Do you have any ideas on how I can solve this?

      1 Reply Last reply Reply Quote 0
      • OrionGroup
        OrionGroup last edited by

        Try adding something like this to your robots.txt file:

        User-agent: rogerbot
        Disallow: /product/samples/product/
        Disallow: /product/samples2/product1/
        Disallow: /product/samples3/product4/

        etc...

        dresults 1 Reply Last reply Reply Quote 0
        • dresults
          dresults @OrionGroup last edited by

          Thanks Scott, this is really helpful.

          Out of interest, would disallowing '/product/samples/product' automatically stop the bots from indexing all the pages underneath this, too such as '/product/samples/product/product/product/'?

          OrionGroup 1 Reply Last reply Reply Quote 0
          • OrionGroup
            OrionGroup @dresults last edited by

            Yes, anything deeper would also be blocked.

            1 Reply Last reply Reply Quote 1
            • Dr-Pete
              Dr-Pete last edited by

              I'm not a Drupal expert, but it sounds like you may have some kind of relative path that's getting perpetuated. Robots.txt could help as a patch, but I'd definitely want to solve the crawl problem, as this could spin out into other problems.

              Have you tried a desktop crawler, like Xenu or Screaming Frog? Sorry, it's tough to diagnose without seeing the actual site, but it's almost got to be a relative path that's causing "/product" to keep being added to links.

              1 Reply Last reply Reply Quote 1
              • Atlanta-SMO
                Atlanta-SMO last edited by

                Can you list the modules you're running?  What e-Commerce module are you running?

                1 Reply Last reply Reply Quote 0
                • ann.stringer
                  ann.stringer last edited by

                  I'm having this same issue with a new drupal site. Does anyone know the underlying cause and how to fix it.

                  Would any relative path cause this?

                  Thanks.

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • When is Duplicate Content Duplicate Content
                    AMHC
                    AMHC
                    0
                    6
                    169

                  • Drupal SEO help - Duplicate content but very similar URLS?
                    Party_Experts
                    Party_Experts
                    0
                    11
                    829

                  • Content and url duplication?
                    TommyTan
                    TommyTan
                    0
                    2
                    531

                  • Duplicate content with same URL?
                    PatioLifeStyle
                    PatioLifeStyle
                    0
                    7
                    547

                  • I am trying to correct error report of duplicate page content. However I am unable to find in over 100 blogs the page which contains similar content to the page SEOmoz reported as having similar content is my only option to just dlete the blog page?
                    evolvingSEO
                    evolvingSEO
                    0
                    4
                    344

                  • Duplicate Content from SEOMOZ report?
                    Vahe.Arabian
                    Vahe.Arabian
                    0
                    8
                    628

                  • Drupal URL Aliases vs 301 Redirects + Do URL Aliases create duplicates?
                    YannickVeys
                    YannickVeys
                    0
                    4
                    2.5k

                  • Duplicate content and URL's
                    perfectweb
                    perfectweb
                    0
                    4
                    980

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy