The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. If googlebot fetch doesnt find our site will it be indexed?

    If googlebot fetch doesnt find our site will it be indexed?

    Technical SEO Issues
    4 3 384
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • wonderwall
      wonderwall last edited by

      We have a problem with one of our sites (wordpress) not getting fetched by googlebot.

      Some folders on the url get found others not. So we have isolated it as a wordpress issue.

      Will this affect our page in google serps anytime soon?

      Does any whizz kid out there know how to begin fixing this as we have spent two days solid on this.

      url is www.holden-jones.co.uk

      Thanks in advance guys

      Rob

      1 Reply Last reply Reply Quote 0
      • AdenBrands
        AdenBrands last edited by

        Wordpress has an excellent xml sitemap plugin that automatically creates and submits the site map to google, yahoo and bing, letting them know what to crawl! Not sure if we are allowed to post links? Apologies to admin if not. But here is the plugin... http://www.arnebrachhold.de/projects/wordpress-plugins/google-xml-sitemaps-generator/

        EricaMcGillivray 1 Reply Last reply Reply Quote 0
        • EricaMcGillivray
          EricaMcGillivray @AdenBrands last edited by

          Yes, you can definitely put links in your comments & posts. In fact, if they help out the post and the person asking the question, links are encouraged.

          1 Reply Last reply Reply Quote 0
          • EricaMcGillivray
            EricaMcGillivray last edited by

            The reason that your site's not being indexed is because your robots.txt file is blocking (see: disallow) bots from searching it.

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • Will putting a one page site up for all other countries stop Googlebot from crawling my UK website?
              lbagley
              lbagley
              0
              5
              42

            • Site Not Being Indexed
              MattAntonino
              MattAntonino
              0
              9
              163

            • Why is my site not being indexed?
              MattRoney
              MattRoney
              0
              4
              186

            • Staging site and "live" site have both been indexed by Google
              jesse-landry
              jesse-landry
              0
              6
              1.3k

            • I am Posting an article on my site and another site has asked to use the same article - Is this a duplicate content issue with google if i am the creator of the content and will it penalize our sites - or one more than the other??
              Alex-Harford
              Alex-Harford
              0
              4
              524

            • Will Google index a 301 redirect for a new site?
              StephanM
              StephanM
              0
              2
              666

            • Some sites like bbc.co.uk place the most important category links at the bottom of the page while other sites will place the whole site map there. What are the benefits (or not) of both approaches?
              Christy-Correll
              Christy-Correll
              0
              6
              1.0k

            • Site just will not be reincluded in Google's Index
              OzDave
              OzDave
              0
              16
              1.2k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy