The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Duplicate content

    Duplicate content

    On-Page / Site Optimization
    8 3 562
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • bhanu2217
      bhanu2217 last edited by

      crawler shows following links as duplicate

      http://www.mysite.com

      http://mysite.com

      http://www.mysite.com/

      http://mysite.com.

      http://mysite.com/index.html

      How can i solve this issue?

      1 Reply Last reply Reply Quote 0
      • BrianJGomez
        BrianJGomez last edited by

        Setup a 301 re-direct in your .htaccess file that designates the 'official' home page url. This will eliminate the crawl errors.

        http://www.bruceclay.com/blog/2007/03/how-to-properly-implement-a-301-redirect/

        bhanu2217 2 Replies Last reply Reply Quote 1
        • MalcolmGibb
          MalcolmGibb last edited by

          Google essentially sees those 5 domains as individual sites and will list each as individual sites in results.

          Follow the guide bjgomer liks you to, you need to set up your .htaccess file to resolve www and either finishwith a trailing slash or index.html the former usually being the better. You also need to decide first whether you want your site to be http://mysite.com or http://www.mysite.com.

          1 Reply Last reply Reply Quote 1
          • bhanu2217
            bhanu2217 @BrianJGomez last edited by

            Do i do it one by one?

            Can i set all non www URL to www?

            1 Reply Last reply Reply Quote 0
            • bhanu2217
              bhanu2217 @BrianJGomez last edited by

              I added following line to .htaccess

              RedirectPermanent /index.html http://www.mysite.com/

              Now whenever i open homepage i getting following message

              Moved Permanently

              The document has moved here.

              MalcolmGibb bhanu2217 3 Replies Last reply Reply Quote 0
              • MalcolmGibb
                MalcolmGibb @bhanu2217 last edited by

                try adding this to your .htaccess

                RewriteEngine On
                RewriteCond %{HTTP_HOST} ^princetown.in
                RewriteRule (.*) http://www.princetown.in/$1 [R=301,L]

                1 Reply Last reply Reply Quote 1
                • bhanu2217
                  bhanu2217 @bhanu2217 last edited by

                  This works.Now non www. to www redirection is set. Thanks

                  now how do i solve this

                  www.mysite.com

                  www.mysite.com/index.html

                  will your above code solve this one also?

                  1 Reply Last reply Reply Quote 0
                  • MalcolmGibb
                    MalcolmGibb @bhanu2217 last edited by

                    Try this:

                    RewriteEngine on

                    <code>RewriteCond %{THE_REQUEST} ^.*\/index\.html?\ HTTP/
                    RewriteRule ^(.*)index\.html?$ "/$1" [R=301,L]</code>
                    
                    1 Reply Last reply Reply Quote 1
                    • 1 / 1
                    • First post
                      Last post
                    • Hi - How do you get rid of duplicate content that was accidentally created on a tag url? For example, when I published a new article, the content was duplicated on: /posts/tag/lead-generation/
                      MikeRoberts
                      MikeRoberts
                      0
                      4
                      82

                    • Duplicate content issues - page content and store URLs
                      MonicaOConnor
                      MonicaOConnor
                      0
                      2
                      161

                    • Content with changing URL and duplicate content
                      Christian_T
                      Christian_T
                      2
                      6
                      108

                    • Duplicate Content
                      KaneJamison
                      KaneJamison
                      0
                      7
                      241

                    • Duplicate content
                      KaneJamison
                      KaneJamison
                      0
                      2
                      270

                    • Duplicate content because of content scrapping - please help
                      kchan
                      kchan
                      0
                      2
                      291

                    • Checking for content duplication against content on your own site.
                      CleverPhD
                      CleverPhD
                      0
                      10
                      483

                    • Duplicate Page Content and Duplicate Page Title
                      AlanMosley
                      AlanMosley
                      0
                      5
                      464

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    • Digital Marketers
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy