The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Is there an easier way from the server to prevent duplicate page content?

    Is there an easier way from the server to prevent duplicate page content?

    Technical SEO Issues
    38 8 1.8k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SEOKeith
      SEOKeith @SEOKeith last edited by

      Brian, if you 301 the example.com to www.example.com that will get rid of the duplicate URL issue server side. (this will resolve your current duplicate content issue).

      Additionally I recommend you add the rel=canonical it will prevent other potential duplicate content issues that may arise and is considered good practice to implement.

      The tag looks correct, note the space after the domain in quotes:

      Are you using a CMS ?

      1 Reply Last reply Reply Quote 1
      • brianhughes
        brianhughes @SEOKeith last edited by

        Thank you SEOKeith, what would be the difference between using a 301 in the .htaccess verses the code Ryan suggested <ifmodule mod_rewrite.c="">?</ifmodule>

        Also if I use the 301 redirect in the .htaccess would it cover this issue site wide?

        Okay so the space needs to be there.

        No, I don't use a CMS?

        1 Reply Last reply Reply Quote 0
        • SEOKeith
          SEOKeith @SEOKeith last edited by

          Brian, it's the same thing just a different method both 301.

          No it would not cover the issues site wide only for the home page.

          CMS = Content Management System (an example would be Wordpress or Drupal).

          You should still do the rel="canonical" site wide (on each page).

          All make sense ?

          1 Reply Last reply Reply Quote 1
          • brianhughes
            brianhughes @SEOKeith last edited by

            SEOKeith, the problem is sitewide, all 52 pages. I was hoping to solve the problem in the server and avoid coding each page. But from what I'm gathering is, even if I use the 301 redirect I should still add the rel="canonical" on each page to avoid scraping. This tells the SE that this page is the only page to index and crawl.

            Lol, sorry I didn't recognize the acronym. Yes, I have a site that is through Wordpress and one that is through Joomla. The one that I'm having issues with is not through a CMS though.

            1 Reply Last reply Reply Quote 0
            • SEOKeith
              SEOKeith @SEOKeith last edited by

              I recommend you update each page, note the rel canonical tag will be different for each page. And 50 pages should take you less than 15 mins 🙂

              1 Reply Last reply Reply Quote 1
              • brianhughes
                brianhughes @SEOKeith last edited by

                Thank you again SEOKeith, I understand what has to be done. I just wanted to make sure I was clear on what needed to be done. Yes, the rel canonical tag will reflect whatever the page is I'm adding it. 🙂 Since I didn't get the errors for it I never added it to my other sites; so now I have to it for all of them. Fun...

                1 Reply Last reply Reply Quote 0
                • Dr-Pete
                  Dr-Pete last edited by

                  Just to clarify, the rewrite that Ryan is proposing IS a 301-redirect (see the "R=301") - it's just one way to implement it. Done right, it can be used sitewide.

                  It's perfectly viable to also use canonicals (and I definitely think they're great to have on the home-page, for example), but I think the 301 is more standard practice here. It's best for search crawlers AND visitors to see your canonical URL (www vs. non-www, whichever you choose). That leads people to link to the "proper" version, bookmark it, promote it on social, etc.

                  Make sure, too, to use the canonical version internally. It's amazing how often people 301-redirect to "www." but then link to the non-www version internally, or vise-versa. Consistent signals are important.

                  SEOKeith brianhughes 2 Replies Last reply Reply Quote 3
                  • Dr-Pete
                    Dr-Pete @KeriMorgret last edited by

                    Expounding is what I do 🙂 Other people use different words for it...

                    1 Reply Last reply Reply Quote 1
                    • SEOKeith
                      SEOKeith @SEOKeith last edited by

                      Sorry I just read this again, the 301 will fix the URL issue site wide.

                      1 Reply Last reply Reply Quote 1
                      • SEOKeith
                        SEOKeith @Dr-Pete last edited by

                        Hi Dr Pete, Would correcting the current issue with a 301 and adding the rel=canonical tags to each page be the best option? My thought being any future duplicate content issues that may occur (not caused from this issue) would be avoided.

                        Dr-Pete brianhughes 2 Replies Last reply Reply Quote 1
                        • BobLongman
                          BobLongman last edited by

                          I'm still getting a bad canonical problem, even with every page having a rel="canonical". It even shows up in SEOmoz's stats, with it indexing 300+ pages when there's only 180-odd.  Trouble is, the .htaccess file says "FrontPage" not Apache.  Would your .htaccess thingy for Apache work there?  And is it the .htaccess that's in the url's folder with the rest of the site's regular files, or one that's in a prev. folder?

                          brianhughes AdoptionHelp 2 Replies Last reply Reply Quote 1
                          • brianhughes
                            brianhughes @Dr-Pete last edited by

                            Dr. Peter, thank you for clarifying this. I do see the R=301 now but I didn't see it before.

                            That's what I figured. Is their a preferred 301 code to use?

                            Yes, I will be sure to use it internally as well. I can see where that would be a mess. Thank you again for sharing your expertise.

                            Dr-Pete brianhughes 4 Replies Last reply Reply Quote 0
                            • brianhughes
                              brianhughes @KeriMorgret last edited by

                              Thank you for expounding on this issue 🙂 I thought it fit.

                              1 Reply Last reply Reply Quote 0
                              • brianhughes
                                brianhughes @BobLongman last edited by

                                Make sure you have a space after the second quotation:

                                1 Reply Last reply Reply Quote 0
                                • AdoptionHelp
                                  AdoptionHelp @BobLongman last edited by

                                  Robert check this article out re: frontpage and htaccess

                                  Frontpage is an html editor that helps you build a site. Apache is a server that site can run on. It sounds like you have both.

                                  You'll want to edit the .htaccess file in the root folder of your website, wherever the file for your homepage sits.

                                  BobLongman 1 Reply Last reply Reply Quote 2
                                  • Dr-Pete
                                    Dr-Pete @SEOKeith last edited by

                                    In most cases, I don't find sitewide canonical tags to really be necessary, but if they're done right, they can't hurt. The trick is that people often screw them up (and bad canonicals can be really bad). I do like one on the home-page, because it sweeps up all the weird variants that are so common for home pages.

                                    1 Reply Last reply Reply Quote 1
                                    • Dr-Pete
                                      Dr-Pete @brianhughes last edited by

                                      As long as the tactic you use returns a proper 301, there's really no way that's better than any other. Ryan's approach works perfectly well for Apache-hosted sites.

                                      1 Reply Last reply Reply Quote 1
                                      • brianhughes
                                        brianhughes @SEOKeith last edited by

                                        If that's the case Dr. Pete, that saves me from having to add the tag to 51 pages. I already have one on the homepage. Thank you.

                                        1 Reply Last reply Reply Quote 0
                                        • brianhughes
                                          brianhughes @brianhughes last edited by

                                          Okay, so the code variant will rely on the type of server?

                                          1 Reply Last reply Reply Quote 0
                                          • Dr-Pete
                                            Dr-Pete @brianhughes last edited by

                                            Yes, a 301-redirect is almost always a server-level directive. It's not a tag or HTML element. You can create them with code (in the header of the page), but that's typically harder and only for special cases.

                                            1 Reply Last reply Reply Quote 1
                                            • 1
                                            • 2
                                            • 2 / 2
                                            • First post
                                              Last post
                                            • Pages with Duplicate Page Content Crawl Diagnostics
                                              evolvingSEO
                                              evolvingSEO
                                              0
                                              6
                                              243

                                            • What is the best way to handle these duplicate page content errors?
                                              Felip3
                                              Felip3
                                              0
                                              3
                                              100

                                            • Issue: Duplicate Page Content > Wordpress Comments Page
                                              DomainUltra
                                              DomainUltra
                                              0
                                              6
                                              1.3k

                                            • Container Page/Content Page Duplicate Content
                                              ProductiveEdge
                                              ProductiveEdge
                                              1
                                              4
                                              194

                                            • I am trying to correct error report of duplicate page content. However I am unable to find in over 100 blogs the page which contains similar content to the page SEOmoz reported as having similar content is my only option to just dlete the blog page?
                                              evolvingSEO
                                              evolvingSEO
                                              0
                                              4
                                              344

                                            • How can I prevent duplicate content between www.page.com/ and www.page.com
                                              onlineexpression
                                              onlineexpression
                                              0
                                              4
                                              536

                                            • Duplicate Page Content Lists the same page twice?
                                              RyanKent
                                              RyanKent
                                              0
                                              2
                                              564

                                            • What's the best way to eliminate duplicate page content caused by blog archives?
                                              lavellester
                                              lavellester
                                              0
                                              6
                                              837

                                            Get started with Moz Pro!

                                            Unlock the power of advanced SEO tools and data-driven insights.

                                            Start my free trial
                                            Products
                                            • Moz Pro
                                            • Moz Local
                                            • Moz API
                                            • Moz Data
                                            • STAT
                                            • Product Updates
                                            Moz Solutions
                                            • SMB Solutions
                                            • Agency Solutions
                                            • Enterprise Solutions
                                            • Digital Marketers
                                            Free SEO Tools
                                            • Domain Authority Checker
                                            • Link Explorer
                                            • Keyword Explorer
                                            • Competitive Research
                                            • Brand Authority Checker
                                            • Local Citation Checker
                                            • MozBar Extension
                                            • MozCast
                                            Resources
                                            • Blog
                                            • SEO Learning Center
                                            • Help Hub
                                            • Beginner's Guide to SEO
                                            • How-to Guides
                                            • Moz Academy
                                            • API Docs
                                            About Moz
                                            • About
                                            • Team
                                            • Careers
                                            • Contact
                                            Why Moz
                                            • Case Studies
                                            • Testimonials
                                            Get Involved
                                            • Become an Affiliate
                                            • MozCon
                                            • Webinars
                                            • Practical Marketer Series
                                            • MozPod
                                            Connect with us

                                            Contact the Help team

                                            Join our newsletter
                                            Moz logo
                                            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                            • Accessibility
                                            • Terms of Use
                                            • Privacy