The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Getting Started
    4. Crawler Accessibilit

    Crawler Accessibilit

    Getting Started
    2 2 37
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Avatardesk1
      Avatardesk1 last edited by

      In Insights section of MOZ campaign, I'm seeing this: https://imgur.com/Gu2K9dz

      Here are the contents of robots.txt:

      User-agent: *
      Disallow: /wp-admin/

      Sitemap: http://website.com.com/sitemap_index.xml

      Can you please let me know what is wrong here?

      Gu2K9dz

      1 Reply Last reply Reply Quote 1
      • meghanpahinui
        meghanpahinui last edited by

        Hi there!

        Thanks so much for the great question! The data that populates in the homepage insights module in your Campaign is pulled when your Campaign is initially created and we do not update that info with each crawl like your other data. If something has changed since the Campaign was initially created, that module will not reflect the change. Sorry for that confusion!

        If you'd like me to look into this further for your specific Campaign, I would be happy to do so! I would just need you to send an email on over to help@moz.com with the Campaign name so we can investigate.

        I hope this helps!

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • How to increase website Moz DA/PA?
          elonmmusk
          elonmmusk
          0
          6
          41

        • DA error in my website
          Bdgbye
          Bdgbye
          0
          4
          43

        • Moz DA Issue
          BartonInteractive
          BartonInteractive
          0
          3
          33

        • Finding less competitive keywords
          Oinsiie78
          Oinsiie78
          0
          2
          36

        • Da Decreased
          Staunton_Rook
          Staunton_Rook
          0
          2
          34

        • Website DA Decreased
          ishahid007
          ishahid007
          0
          5
          29

        • Our crawler was not able to access the robots.txt file on your site
          LoganRay
          LoganRay
          0
          4
          1.1k

        • Can't track my site, keep getting "Ooops. Our crawlers are unable to access that URL"
          Hurf
          Hurf
          0
          6
          104

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy