The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Website being crawled but not indexed any thoughts?

    Website being crawled but not indexed any thoughts?

    Technical SEO Issues
    6 3 3.7k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Ant71
      Ant71 last edited by

      Hi Everyone,
      I created a new website a few weeks ago www.drivingseaford.co.uk , did a little link citation, links from Google+, submitted to webmaster tools etc but its still not getting indexed.

      Webmaster tools crawl stats page is showing pages being crawled, no errors. But 0 indexed.

      http://www.drivingseaford.co.uk/robots.txt is showing

      User-agent: *
      Disallow: /wp-admin/
      Disallow: /wp-includes/
      

      Im a bit stumped as never had this before!!! Any ideas from you lovely people??

      Antony

      1 Reply Last reply Reply Quote 0
      • Chris.Menke
        Chris.Menke last edited by

        Anthony, I'm guessing that it has to do with your content and how similar it is to a number of other sites of yours.  Be sure to use original content on each of your sites and work to get some quality links going to each of those sites.

        1 Reply Last reply Reply Quote 0
        • Aeronet
          Aeronet last edited by

          Hi Antony,

          Saw that you had

          <meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">none</a>" />
          

          on your website, and as it's said here http://googlewebmastercentral.blogspot.fr/2007/03/using-robots-meta-tag.html, that means NOINDEX,NOFOLLOW 🙂

          So just erase those lines and you should be good !

          Chris.Menke Ant71 2 Replies Last reply Reply Quote 1
          • Chris.Menke
            Chris.Menke @Aeronet last edited by

            Good catch!  I noticed that as well, but had never seen content="none" and didn't look into it any further.  However, Anthony, you are going down the wrong path as far as your content and you're going to have to spruce that up for your sites or you're setting yourself up for panda problems.

            Ant71 1 Reply Last reply Reply Quote 0
            • Ant71
              Ant71 @Aeronet last edited by

              Ah ok it was something in the Wordpress theme options for "Choose Google Bot Indexing Type" that wasnt selected. Ive now changed it to

              Thanks for that. Much appreciated.

              1 Reply Last reply Reply Quote 0
              • Ant71
                Ant71 @Chris.Menke last edited by

                Your absolutely right Chris, I was in the process of rewriting all the content and going to be getting the blog going. Also now looking at quality links etc. Google places done, so was trying to get some local citations.

                Ant

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Website indexing issues
                  jasongmcmahon
                  jasongmcmahon
                  0
                  3
                  41

                • Mobile website indexing
                  paints-n-design
                  paints-n-design
                  0
                  6
                  143

                • Google Crawling Issues! How Can I Get Google to Crawl My Website Regularly?
                  libero_net
                  libero_net
                  1
                  8
                  142

                • My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
                  Vuly
                  Vuly
                  0
                  5
                  1.6k

                • Removing indexed website
                  geekwik
                  geekwik
                  0
                  6
                  128

                • My website pages are not crawled, what to do?
                  SeoMartin1
                  SeoMartin1
                  0
                  10
                  281

                • My Website is not being crawled by Google
                  MarieHaynes
                  MarieHaynes
                  0
                  16
                  2.0k

                • Database Driven Websites: Crawling and Indexing Issues
                  Bandicoot
                  Bandicoot
                  0
                  3
                  1.0k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy