The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Problem with indexing

    Problem with indexing

    Technical SEO Issues
    13 5 708
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • malachiii
      malachiii last edited by

      are you using the exact same URL's with the new CMS as the old cms? if not have you done 301's?

      1 Reply Last reply Reply Quote 0
      • ufmedia
        ufmedia last edited by

        Have you tried crawling it with Xenu?

        divan 1 Reply Last reply Reply Quote 0
        • bootleg
          bootleg last edited by

          There's nothing wrong with the links and with your robots.txt. But ...

          You obviously have a huge duplicate content problem. Just look at the search result the site: query returns. There are a lot of old links (from the old CMS I suppose). Click through the links and you'll always get to the main page, but the URL remains the same. I.e. no redirect to the correct page with the new URL or to the Homepage.

          You should have a look at your old URLs and redirect them with a HTTP 301 redirect to the new URL.

          As a quick fix add a rel="canonical" tag to your new pages. This way google will index the correct page (and only the correct page) on its next crawl. Setting up the redirects should have happened prior to switching the CMS ...

          divan 1 Reply Last reply Reply Quote 1
          • MarieHaynes
            MarieHaynes last edited by

            How long has it been since you've had the new CMS?  It can sometimes take weeks to get a site crawled and indexed.

            I'll share with you something that happened to me recently that may be applicable.  I recently started a new site and wrote a few blog posts.  Then I changed my mind and decided that those posts would be better suited to another site I had.  So, I added them to another site I had.  But, they wouldn't index!  I realized that I hadn't deleted the content off of my first site.  So, when Google came across the new blog I'm assuming they saw all the content as duplicate and didn't index it.  I immediately took the content off of the original domain and I 301'd the original domain to the new one and within hours all of my posts were indexed.

            divan 1 Reply Last reply Reply Quote 0
            • divan
              divan @bootleg last edited by

              Thank you for the heads up. We know about the duplicate content problem, just our webmaster is somewhat slow.

              The URLs are new, and we will do 301 redirect and "canonical".

              malachiii 1 Reply Last reply Reply Quote 0
              • divan
                divan @MarieHaynes last edited by

                There are some new pages we've made, and still no indexing. Google visited our page quite often, and it's been almost 1 month since we've changed the URLs.

                malachiii MarieHaynes divan 4 Replies Last reply Reply Quote 0
                • divan
                  divan @ufmedia last edited by

                  Yes, I've tried Xenu (right after you asked me), it shows broken links.

                  1 Reply Last reply Reply Quote 0
                  • malachiii
                    malachiii @divan last edited by

                    good catch bootleg. I think if you get the dupe content and 301's working correctly google will love you a little more.

                    1 Reply Last reply Reply Quote 0
                    • malachiii
                      malachiii @divan last edited by

                      You may have to resubmit your site through webmaster tools AFTER fixing the forementioned issues.

                      1 Reply Last reply Reply Quote 1
                      • MarieHaynes
                        MarieHaynes @divan last edited by

                        In my case above, I had new pages as well that weren't being indexed, but they did get indexed once I dealt with the duplicate content.  Perhaps Google put some sort of block on my whole blog because of the duplicates?  If your information is duplicated anywhere you need to check this.

                        Also, do you have webmaster tools set up?  This will tell you a lot about what is happening with your domain.  Have you submitted a sitemap?  This will help as well.

                        It may also help to build a few external links to some of the new pages.  This will help Google find them.

                        1 Reply Last reply Reply Quote 0
                        • divan
                          divan @divan last edited by

                          Thank you. I'm sure it's not a duplicate content problem. For example even when I try to put new URL as destination in Ad words, and it didn't took as working.

                          I think it's more of a technical issue, not SEO, probably was a wrong question here.

                          Thank you again everyone for helping me out.

                          1 Reply Last reply Reply Quote 0
                          • MarieHaynes
                            MarieHaynes @divan last edited by

                            I just want to clarify what I was saying above.  In my case, even though I put brand spanking new posts on my blog they weren't getting indexed.  I had about 6 duplicate posts and 4 new ones and none of them were getting indexed.  But, when I dealt with the duplicate content issues for those 6 (i.e got rid of the original copies and redirected the old site to the new) then all of my content suddenly got indexed.  Just sayin'

                            1 Reply Last reply Reply Quote 0
                            • 1 / 1
                            • First post
                              Last post
                            • My wordpress website is facing indexing problems
                              0
                              1
                              23

                            • Index problems, Part 2
                              BlueprintMarketing
                              BlueprintMarketing
                              3
                              8
                              169

                            • Having Problems to Index all URLs on Sitemap
                              Martijn_Scheijbeler
                              Martijn_Scheijbeler
                              0
                              4
                              150

                            • Problems with to many indexed pages
                              Everett
                              Everett
                              0
                              8
                              106

                            • Carwling and indexing problems
                              Raydon
                              Raydon
                              0
                              2
                              112

                            • Correct Indexing problem
                              donford
                              donford
                              0
                              4
                              499

                            • Problem with indexed files before domain was purchased
                              pwpaneuro
                              pwpaneuro
                              0
                              5
                              588

                            Get started with Moz Pro!

                            Unlock the power of advanced SEO tools and data-driven insights.

                            Start my free trial
                            Products
                            • Moz Pro
                            • Moz Local
                            • Moz API
                            • Moz Data
                            • STAT
                            • Product Updates
                            Moz Solutions
                            • SMB Solutions
                            • Agency Solutions
                            • Enterprise Solutions
                            • Digital Marketers
                            Free SEO Tools
                            • Domain Authority Checker
                            • Link Explorer
                            • Keyword Explorer
                            • Competitive Research
                            • Brand Authority Checker
                            • Local Citation Checker
                            • MozBar Extension
                            • MozCast
                            Resources
                            • Blog
                            • SEO Learning Center
                            • Help Hub
                            • Beginner's Guide to SEO
                            • How-to Guides
                            • Moz Academy
                            • API Docs
                            About Moz
                            • About
                            • Team
                            • Careers
                            • Contact
                            Why Moz
                            • Case Studies
                            • Testimonials
                            Get Involved
                            • Become an Affiliate
                            • MozCon
                            • Webinars
                            • Practical Marketer Series
                            • MozPod
                            Connect with us

                            Contact the Help team

                            Join our newsletter
                            Moz logo
                            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                            • Accessibility
                            • Terms of Use
                            • Privacy