The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. 20 000 duplicates in Moz crawl due to Joomla URL parameters. How to fix?

    20 000 duplicates in Moz crawl due to Joomla URL parameters. How to fix?

    Technical SEO Issues
    3 3 229
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Xmanic
      Xmanic last edited by

      We have a problem of massive duplicate content in Joomla. Here is an example of the "base" URL: http://www.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html

      For some reason Joomla creates many versions of this URL, for example:

      http://www.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html

      or

      http://www.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html

      So it lists the URL parameter ?q= and then repeats part of the beforegoing URL. This leads to tens of thousands duplicate pages in our content heavy site.

      Any ideas how to fix this? Thanks so much!

      1 Reply Last reply Reply Quote 0
      • csfarnsworth
        csfarnsworth last edited by

        Surely your URL structure is not fine.Can you please try this fix and update me?

        http://docs.joomla.org/Enabling_Search_Engine_Friendly_(SEF)_URLs_on_Apache

        1 Reply Last reply Reply Quote 0
        • Milian
          Milian last edited by

          These are caused by the links to your language pages.  If you click one of the language links from within the source code (not on the page) it redirects to a URL with '?q=/index.php/Web-Pages/binary-options-platforms.html' added. Then if you click the same language link on that page it again redirects to another page with previous URL added to the end:
          ?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html.

          e.g:

          On the example page view source, search for German and click the link below:

          http://de.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html

          This link 301 redirects too:

          http://www.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html Then if you view source, search for German and click the link again:

          http://de.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html

          This link 301 redirects too:

          http://www.binary-options.biz/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html?q=/index.php/Web-Pages/binary-options-platforms.html

          So basically every time a web crawler follows a language link, new URLs are being created with the previous URL added to the end, causing a never ending crawl as an infinite amount of new pages will always be created.

          I don't think this is connected with the Joomla SEF as Chris pointed out, as your URLs are already SEF.

          However it's not an easy thing to identify how to fix the issue with the language links. You should probably speak to the developer who implemented it and/or the creator of the plugin if it is a plugin.

          Also do you even need this functionality? As none of the language links work, they just redirect back the main site.

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Clean URL vs. Parameter URL and Using Canonical URL...That's a Mouthfull!
            Roman-Delcarmen
            Roman-Delcarmen
            0
            4
            170

          • Why Google crawl parameter URLs?
            Rajesh.Prajapati
            Rajesh.Prajapati
            0
            2
            86

          • WEBMASTER console: increase in the number of URLs we were blocked from crawling due to authorization permission errors.
            odmsoft
            odmsoft
            0
            21
            835

          • 150+ Pages of URL Parameters - Mass Duplicate Content Issue?
            TomRayner
            TomRayner
            0
            5
            227

          • Blocked URL parameters can still be crawled and indexed by google?
            anthonydnelson
            anthonydnelson
            0
            6
            1.7k

          • Moz Crawl Diagnostic shows lots of duplicate content issues
            jesse-landry
            jesse-landry
            0
            3
            161

          • Duplicated content in moz report due to Magento urls in a multiple language store.
            LynnPatchett
            LynnPatchett
            0
            2
            481

          • Duplicate pages in Google index despite canonical tag and URL Parameter in GWMT
            Dr-Pete
            Dr-Pete
            0
            5
            2.1k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy