The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Problem with indexing

    Problem with indexing

    Technical SEO Issues
    13 5 708
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • divan
      divan last edited by

      Hello, we've changed our CMS recently, everything seems to work well, but for some reason google, and other crawlers can't see or index other pages than main. There is no restriction in robots, nor any other visible issue. Please help if you can.

      Website: http://www.design-glassware.com/

      1 Reply Last reply Reply Quote 0
      • malachiii
        malachiii last edited by

        are you using the exact same URL's with the new CMS as the old cms? if not have you done 301's?

        1 Reply Last reply Reply Quote 0
        • ufmedia
          ufmedia last edited by

          Have you tried crawling it with Xenu?

          divan 1 Reply Last reply Reply Quote 0
          • bootleg
            bootleg last edited by

            There's nothing wrong with the links and with your robots.txt. But ...

            You obviously have a huge duplicate content problem. Just look at the search result the site: query returns. There are a lot of old links (from the old CMS I suppose). Click through the links and you'll always get to the main page, but the URL remains the same. I.e. no redirect to the correct page with the new URL or to the Homepage.

            You should have a look at your old URLs and redirect them with a HTTP 301 redirect to the new URL.

            As a quick fix add a rel="canonical" tag to your new pages. This way google will index the correct page (and only the correct page) on its next crawl. Setting up the redirects should have happened prior to switching the CMS ...

            divan 1 Reply Last reply Reply Quote 1
            • MarieHaynes
              MarieHaynes last edited by

              How long has it been since you've had the new CMS?  It can sometimes take weeks to get a site crawled and indexed.

              I'll share with you something that happened to me recently that may be applicable.  I recently started a new site and wrote a few blog posts.  Then I changed my mind and decided that those posts would be better suited to another site I had.  So, I added them to another site I had.  But, they wouldn't index!  I realized that I hadn't deleted the content off of my first site.  So, when Google came across the new blog I'm assuming they saw all the content as duplicate and didn't index it.  I immediately took the content off of the original domain and I 301'd the original domain to the new one and within hours all of my posts were indexed.

              divan 1 Reply Last reply Reply Quote 0
              • divan
                divan @bootleg last edited by

                Thank you for the heads up. We know about the duplicate content problem, just our webmaster is somewhat slow.

                The URLs are new, and we will do 301 redirect and "canonical".

                malachiii 1 Reply Last reply Reply Quote 0
                • divan
                  divan @MarieHaynes last edited by

                  There are some new pages we've made, and still no indexing. Google visited our page quite often, and it's been almost 1 month since we've changed the URLs.

                  malachiii MarieHaynes divan 4 Replies Last reply Reply Quote 0
                  • divan
                    divan @ufmedia last edited by

                    Yes, I've tried Xenu (right after you asked me), it shows broken links.

                    1 Reply Last reply Reply Quote 0
                    • malachiii
                      malachiii @divan last edited by

                      good catch bootleg. I think if you get the dupe content and 301's working correctly google will love you a little more.

                      1 Reply Last reply Reply Quote 0
                      • malachiii
                        malachiii @divan last edited by

                        You may have to resubmit your site through webmaster tools AFTER fixing the forementioned issues.

                        1 Reply Last reply Reply Quote 1
                        • MarieHaynes
                          MarieHaynes @divan last edited by

                          In my case above, I had new pages as well that weren't being indexed, but they did get indexed once I dealt with the duplicate content.  Perhaps Google put some sort of block on my whole blog because of the duplicates?  If your information is duplicated anywhere you need to check this.

                          Also, do you have webmaster tools set up?  This will tell you a lot about what is happening with your domain.  Have you submitted a sitemap?  This will help as well.

                          It may also help to build a few external links to some of the new pages.  This will help Google find them.

                          1 Reply Last reply Reply Quote 0
                          • divan
                            divan @divan last edited by

                            Thank you. I'm sure it's not a duplicate content problem. For example even when I try to put new URL as destination in Ad words, and it didn't took as working.

                            I think it's more of a technical issue, not SEO, probably was a wrong question here.

                            Thank you again everyone for helping me out.

                            1 Reply Last reply Reply Quote 0
                            • MarieHaynes
                              MarieHaynes @divan last edited by

                              I just want to clarify what I was saying above.  In my case, even though I put brand spanking new posts on my blog they weren't getting indexed.  I had about 6 duplicate posts and 4 new ones and none of them were getting indexed.  But, when I dealt with the duplicate content issues for those 6 (i.e got rid of the original copies and redirected the old site to the new) then all of my content suddenly got indexed.  Just sayin'

                              1 Reply Last reply Reply Quote 0
                              • 1 / 1
                              • First post
                                Last post
                              • Indexing problem a large site
                                Andy-Halliday
                                Andy-Halliday
                                1
                                6
                                67

                              • Indexation and visibility problem
                                MattRoney
                                MattRoney
                                0
                                3
                                80

                              • Index problems, Part 2
                                BlueprintMarketing
                                BlueprintMarketing
                                3
                                8
                                169

                              • Index problems
                                Happy-SEO
                                Happy-SEO
                                1
                                9
                                241

                              • Carwling and indexing problems
                                Raydon
                                Raydon
                                0
                                2
                                112

                              • Problem with indexed files before domain was purchased
                                pwpaneuro
                                pwpaneuro
                                0
                                5
                                588

                              Get started with Moz Pro!

                              Unlock the power of advanced SEO tools and data-driven insights.

                              Start my free trial
                              Products
                              • Moz Pro
                              • Moz Local
                              • Moz API
                              • Moz Data
                              • STAT
                              • Product Updates
                              Moz Solutions
                              • SMB Solutions
                              • Agency Solutions
                              • Enterprise Solutions
                              • Digital Marketers
                              Free SEO Tools
                              • Domain Authority Checker
                              • Link Explorer
                              • Keyword Explorer
                              • Competitive Research
                              • Brand Authority Checker
                              • Local Citation Checker
                              • MozBar Extension
                              • MozCast
                              Resources
                              • Blog
                              • SEO Learning Center
                              • Help Hub
                              • Beginner's Guide to SEO
                              • How-to Guides
                              • Moz Academy
                              • API Docs
                              About Moz
                              • About
                              • Team
                              • Careers
                              • Contact
                              Why Moz
                              • Case Studies
                              • Testimonials
                              Get Involved
                              • Become an Affiliate
                              • MozCon
                              • Webinars
                              • Practical Marketer Series
                              • MozPod
                              Connect with us

                              Contact the Help team

                              Join our newsletter
                              Moz logo
                              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                              • Accessibility
                              • Terms of Use
                              • Privacy