The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. How to make Google index your site? (Blocked with robots.txt for a long time)

    How to make Google index your site? (Blocked with robots.txt for a long time)

    Intermediate & Advanced SEO
    3 3 128
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • FCRMediaLietuva
      FCRMediaLietuva last edited by

      The problem is the for the long time we had a website m.imones.lt but it was blocked with robots.txt.
      But after a long time we want Google to index it. We unblocked it 1 week or 8 days ago. But Google still does not recognize it. I type site:m.imones.lt and it says it is still blocked with robots.txt

      What should be the process to make Google crawl this mobile version faster?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • DealWithAutism
        DealWithAutism last edited by

        If you have made sure that your robots.txt is now unblocking it, go to Google Webmastera and select you site for "Fetch as Google" and once fetched sekect submit to index. Usually the oage should get indexed in a day.

        if your page is still not accessible, during the fetch process google should error out call that the page is inaccessible.

        1 Reply Last reply Reply Quote 1
        • SanjidaKazi
          SanjidaKazi last edited by

          Hi There

          You need to unblock the site in your robots.txt and then go into Google webmaster tools and "Fetch as Google". Check out the image I attached for you.

          I usually Fetch and Render then Submit to index. It's usually very quick to index.

          2nzscmZ.png?1

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
            GastonRiera
            GastonRiera
            0
            3
            98

          • My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
            Everett
            Everett
            0
            3
            733

          • Blocking Certain Site Parameters from Google's Index - Please Help
            Jbake
            Jbake
            0
            6
            112

          • Pages getting into Google Index, blocked by Robots.txt??
            Devanur-Rafi
            Devanur-Rafi
            0
            10
            673

          • Google Indexed my Site then De-indexed a Week After
            Jonathan1979
            Jonathan1979
            0
            4
            397

          • Can URLs blocked with robots.txt hurt your site?
            workzentre
            workzentre
            0
            4
            302

          • How long will Google take to read my robots.txt after updating?
            loopyal
            loopyal
            0
            4
            1.1k

          • Is Google just taking long time to re-index or did I make a boo boo?...
            CliffAuerswald
            CliffAuerswald
            0
            3
            632

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy