The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz News
    4. What is robots.txt file issue?

    What is robots.txt file issue?

    Moz News
    2 2 65
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • matee.usman
      matee.usman last edited by

      I hope you are well. Mostly moz send me a notification that your website can,t be crawled and it says me o check robots.txt file. Now the Question is how can solve this problem and what should I write in robots.txt file?

      Here is my website. https://www.myqurantutor.com/

      need your help brohers.... and Thanks in advance

      1 Reply Last reply Reply Quote 0
      • KevinBudzynski
        KevinBudzynski last edited by

        Not sure. Your robots.txt file looks fine & shouldn't be blocking anything except for admin:

        User-agent: *
        Disallow: /wp-admin/
        Allow: /wp-admin/admin-ajax.php
        
        sitemap: https://www.myqurantutor.com/sitemap_index.xml
        
        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • What about a No-record backlink in the eye of Google
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          0
          2
          26

        • April 15, 2021, we'll be sunsetting Brand Mentions Monitoring in Campaigns and Keyword Explorer
          BartonInteractive
          BartonInteractive
          1
          11
          609

        • How to increase priority of my website?
          TOFHA054515
          TOFHA054515
          0
          2
          32

        • What about a No-record backlink in the counting of Google
          Hammad63636
          Hammad63636
          0
          2
          24

        • What is Page Rank or PR?
          sjoie73
          sjoie73
          0
          2
          37

        • Have you scheduled your personalized walkthrough of Moz Pro?
          Oinsiie78
          Oinsiie78
          7
          37
          924

        • Why should I continue my MOZ subscription ?
          Nick_Sayers
          Nick_Sayers
          1
          14
          402

        • Issue: 5XX (Server Error)
          josh-riley
          josh-riley
          0
          4
          4.7k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy