The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Why are only PDFs on my client's site being indexed, and not actual pages?

    Why are only PDFs on my client's site being indexed, and not actual pages?

    Technical SEO Issues
    5 3 133
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mfrgolfgti
      mfrgolfgti last edited by

      My client has recently built a new site (we did not build this), which is a subdomain of their main site. The new site is: https://addstore.itelligencegroup.com/uk/en/. (Their main domain is: http://itelligencegroup.com/uk/)

      This new Addstore site has recently gone live (in the past week or so) and so far, Google appears to have indexed 56 pdf files that are on the site, but it hasn't indexed any of the actual web pages yet. I can't figure out why though.

      I've checked the robots.txt file for the site which appears to be fine: https://addstore.itelligencegroup.com/robots.txt.

      Does anyone have any ideas about this?

      1 Reply Last reply Reply Quote 0
      • ramansaab
        ramansaab last edited by

        Did you try FETCH AS GOOGLE web master tool to index your sub domain pages?

        1 Reply Last reply Reply Quote 0
        • mfrgolfgti
          mfrgolfgti last edited by

          Hi Ramansaab

          Yes, but I have asked the client to change the way that Webmasters is set up because at the moment when we try to submit a page, it points to a redirect. So because Webmasters can't follow a redirect I have to wait for the client to set it up with the right url for the domain. They have set it up as www.addstore.itelligencegroup.com/uk/en when in fact it should be addstore.itelligencegroup.com/uk/en.

          1 Reply Last reply Reply Quote 0
          • AndersS
            AndersS last edited by

            Hi Maureen!

            It seems that your pages all have the following code inside the :
            <meta content="<a class="attribute-value">noindex,follow</a>" name="<a class="attribute-value">robots</a>">
            It will effectively block all your pages from being indexed, and should be removed (or changed into <meta content="<a class="attribute-value">index,follow</a>" name="<a class="attribute-value">robots</a>"> )

            Also, you should update the robots.txt to reference the full URL for the XML sitemap? I think the specifications for referenging this demands full URL's.

            Hope this helps 🙂
            Anders

            mfrgolfgti 1 Reply Last reply Reply Quote 3
            • mfrgolfgti
              mfrgolfgti @AndersS last edited by

              Thank you so much, Anders, I am getting the client to change this immediately. Brilliant answer!

              1 Reply Last reply Reply Quote 1
              • 1 / 1
              • First post
                Last post
              • Strange URL's for client's site
                everestagency
                everestagency
                0
                3
                456

              • Google how deal with licensed content when this placed on vendor & client's website too. Will Google penalize the client's site for this ?
                katemorris
                katemorris
                1
                4
                94

              • Test site got indexed in Google - What's the best way of getting the pages removed from the SERP's?
                Yarden_Uitvaartorganisatie
                Yarden_Uitvaartorganisatie
                0
                5
                1.3k

              • How to create site map for large site (ecommerce type) that has 1000's if not 100,000 of pages.
                Robin_Jennings
                Robin_Jennings
                0
                10
                9.5k

              • How Does Google's "index" find the location of pages in the "page directory" to return?
                reidsteven75
                reidsteven75
                0
                9
                215

              • Lots of Pages Dropped Out of Google's Index?
                ThompsonPaul
                ThompsonPaul
                0
                3
                1.0k

              • Removing a site from Google's index
                issuebasedmedia
                issuebasedmedia
                0
                13
                976

              • Site just will not be reincluded in Google's Index
                OzDave
                OzDave
                0
                16
                1.2k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy