The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Search engines have been blocked by robots.txt., how do I find and fix it?

    Search engines have been blocked by robots.txt., how do I find and fix it?

    Technical SEO Issues
    7 4 524
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • LeslieVS
      LeslieVS last edited by

      My client site royaloakshomesfl.com is coming up in my dashboard as having Search engines have been blocked by robots.txt, only I have no idea where to find it and fix the problem. Please help! I do have access to webmaster tools and this site is a WP site, if that helps.

      1 Reply Last reply Reply Quote 0
      • lavellester
        lavellester last edited by

        You can see it here:

        http://royaloakshomesfl.com/robots.txt

        So its in the webroot of your hosting.  You can change it via FTP to and change it to the following to grant full access until you have figured out robot access rights.  I think you need at least one Disallow: line without the / slash in your existing configuration to make it work.

        User-agent: *
        Disallow: 
        
        AlanMosley 1 Reply Last reply Reply Quote 1
        • AlanMosley
          AlanMosley @lavellester last edited by

          I would do as Lavellester suggest, then i would then i would re-submit as i can see you are not in either index.

          LeslieVS lavellester 3 Replies Last reply Reply Quote 1
          • LeslieVS
            LeslieVS @AlanMosley last edited by

            When I search their brand name, they pop up in Google, so they must be indexed somehow, no?

            1 Reply Last reply Reply Quote -1
            • lavellester
              lavellester @AlanMosley last edited by

              nothing comes back when I run this

              site:www.royaloakshomesfl.com

              So looks like its not indexed

              1 Reply Last reply Reply Quote 0
              • LeslieVS
                LeslieVS @AlanMosley last edited by

                Ah, I see. Thanks!!

                1 Reply Last reply Reply Quote -1
                • KeriMorgret
                  KeriMorgret last edited by

                  Here's the screen in Wordpress to check to see if you've blocked search engines through WP.

                  http://codex.wordpress.org/Settings_Privacy_Screen

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • Blocking subdomains with Robots.txt file
                    PaulM01
                    PaulM01
                    0
                    3
                    641

                  • Robots.txt blocking Addon Domains
                    eglove
                    eglove
                    0
                    10
                    556

                  • Should I block Map pages with robots.txt?
                    imaginex
                    imaginex
                    0
                    3
                    73

                  • I accidentally blocked Google with Robots.txt. What next?
                    SebastianCowie
                    SebastianCowie
                    0
                    7
                    2.1k

                  • Should search pages be disallowed in robots.txt?
                    MichaelWeisbaum
                    MichaelWeisbaum
                    0
                    3
                    335

                  • Search Engine Blocked by Robot Txt warnings for Filter Search result pages--Why?
                    languedoc
                    languedoc
                    0
                    5
                    915

                  • How to recover after blocking all the search engine spiders?
                    GroupM
                    GroupM
                    0
                    3
                    831

                  • Robots.txt and robots meta
                    TheEspresseo
                    TheEspresseo
                    0
                    5
                    1.1k

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy