The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. How to make Google index your site? (Blocked with robots.txt for a long time)

    How to make Google index your site? (Blocked with robots.txt for a long time)

    Intermediate & Advanced SEO
    3 3 128
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • FCRMediaLietuva
      FCRMediaLietuva last edited by

      The problem is the for the long time we had a website m.imones.lt but it was blocked with robots.txt.
      But after a long time we want Google to index it. We unblocked it 1 week or 8 days ago. But Google still does not recognize it. I type site:m.imones.lt and it says it is still blocked with robots.txt

      What should be the process to make Google crawl this mobile version faster?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • DealWithAutism
        DealWithAutism last edited by

        If you have made sure that your robots.txt is now unblocking it, go to Google Webmastera and select you site for "Fetch as Google" and once fetched sekect submit to index. Usually the oage should get indexed in a day.

        if your page is still not accessible, during the fetch process google should error out call that the page is inaccessible.

        1 Reply Last reply Reply Quote 1
        • SanjidaKazi
          SanjidaKazi last edited by

          Hi There

          You need to unblock the site in your robots.txt and then go into Google webmaster tools and "Fetch as Google". Check out the image I attached for you.

          I usually Fetch and Render then Submit to index. It's usually very quick to index.

          2nzscmZ.png?1

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • How long will old pages stay in Google's cache index. We have a new site that is two months old but we are seeing old pages even though we used 301 redirects.
            DonnaDuncan
            DonnaDuncan
            0
            3
            81

          • My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
            Everett
            Everett
            0
            3
            733

          • Using folder blocked by robots.txt before uploaded to indexed folder - is that OK?
            khi5
            khi5
            0
            4
            100

          • Pages getting into Google Index, blocked by Robots.txt??
            Devanur-Rafi
            Devanur-Rafi
            0
            10
            673

          • Google showing high volume of URLs blocked by robots.txt in in index-should we be concerned?
            TakeshiYoung
            TakeshiYoung
            0
            4
            302

          • Can URLs blocked with robots.txt hurt your site?
            workzentre
            workzentre
            0
            4
            302

          • How long will Google take to read my robots.txt after updating?
            loopyal
            loopyal
            0
            4
            1.1k

          • Is Google just taking long time to re-index or did I make a boo boo?...
            CliffAuerswald
            CliffAuerswald
            0
            3
            632

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy