The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Drupal infinite URL depth? SEOMOZ treating as duplicate content

    Drupal infinite URL depth? SEOMOZ treating as duplicate content

    Technical SEO Issues
    7 5 300
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dresults
      dresults last edited by

      I'm monitoring a subdirectory of my site on SEOMOZ but with catastrophic results. It's finding infinite duplicate content e.g.www.example.co.uk/product/samples/product/product/productand so on...

      The website is running on Drupal. Do you have any ideas on how I can solve this?

      1 Reply Last reply Reply Quote 0
      • OrionGroup
        OrionGroup last edited by

        Try adding something like this to your robots.txt file:

        User-agent: rogerbot
        Disallow: /product/samples/product/
        Disallow: /product/samples2/product1/
        Disallow: /product/samples3/product4/

        etc...

        dresults 1 Reply Last reply Reply Quote 0
        • dresults
          dresults @OrionGroup last edited by

          Thanks Scott, this is really helpful.

          Out of interest, would disallowing '/product/samples/product' automatically stop the bots from indexing all the pages underneath this, too such as '/product/samples/product/product/product/'?

          OrionGroup 1 Reply Last reply Reply Quote 0
          • OrionGroup
            OrionGroup @dresults last edited by

            Yes, anything deeper would also be blocked.

            1 Reply Last reply Reply Quote 1
            • Dr-Pete
              Dr-Pete last edited by

              I'm not a Drupal expert, but it sounds like you may have some kind of relative path that's getting perpetuated. Robots.txt could help as a patch, but I'd definitely want to solve the crawl problem, as this could spin out into other problems.

              Have you tried a desktop crawler, like Xenu or Screaming Frog? Sorry, it's tough to diagnose without seeing the actual site, but it's almost got to be a relative path that's causing "/product" to keep being added to links.

              1 Reply Last reply Reply Quote 1
              • Atlanta-SMO
                Atlanta-SMO last edited by

                Can you list the modules you're running?  What e-Commerce module are you running?

                1 Reply Last reply Reply Quote 0
                • ann.stringer
                  ann.stringer last edited by

                  I'm having this same issue with a new drupal site. Does anyone know the underlying cause and how to fix it.

                  Would any relative path cause this?

                  Thanks.

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • When is Duplicate Content Duplicate Content
                    AMHC
                    AMHC
                    0
                    6
                    169

                  • Drupal SEO help - Duplicate content but very similar URLS?
                    Party_Experts
                    Party_Experts
                    0
                    11
                    829

                  • Content and url duplication?
                    TommyTan
                    TommyTan
                    0
                    2
                    531

                  • Affiliate urls and duplicate content
                    Memoz
                    Memoz
                    0
                    7
                    413

                  • Duplicate Content and URL Capitalization
                    Marcus_Miller
                    Marcus_Miller
                    0
                    9
                    5.7k

                  • How to find original URLS after Hosting Company added canonical URLs, URL rewrites and duplicate content.
                    Nobody1560986989723
                    Nobody1560986989723
                    0
                    2
                    366

                  • Duplicate Content from SEOMOZ report?
                    Vahe.Arabian
                    Vahe.Arabian
                    0
                    8
                    628

                  • SEOMoz is indicating I have 40 pages with duplicate content, yet it doesn't list the URL's of the pages???
                    RobertFisher
                    RobertFisher
                    0
                    2
                    391

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy