The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Link Explorer
    4. When will Dotbot see changes to my robots.txt file?

    When will Dotbot see changes to my robots.txt file?

    Link Explorer
    9 4 56
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Expansyon
      Expansyon last edited by

      Dotbot doesn't want to know anything about my site, my Page Authotize is still 1 and my DA is the same. How long does it take to start getting results?  In all the websites we have been working on, we have no problems, but in ours it has come up.

      1 Reply Last reply Reply Quote 1
      • RossKernez
        RossKernez last edited by

        Hi there,

        You just need to wait for a little bit longer, so Moz can crawl your site. Meanwhile, you check all your links in Google Search Console.

        Ross

        1 Reply Last reply Reply Quote 2
        • Guest
          Guest last edited by

          This post is deleted!
          1 Reply Last reply Reply Quote 0
          • Guest
            Guest last edited by

            This post is deleted!
            1 Reply Last reply Reply Quote 0
            • Guest
              Guest last edited by

              This post is deleted!
              1 Reply Last reply Reply Quote 0
              • Guest
                Guest last edited by

                This post is deleted!
                1 Reply Last reply Reply Quote 0
                • Guest
                  Guest last edited by

                  This post is deleted!
                  1 Reply Last reply Reply Quote 0
                  • samantha.chapman
                    samantha.chapman last edited by

                    Hi - thanks for contacting us,

                    When you see a DA of 1, this will usually mean that we haven't indexed that site yet or we haven't found any inbound links for that particular site. That can happen for a number of reasons, such as we haven't found any external links to the site or the site is blocking our crawler or the site is fairly new.

                    When we compile our index by first crawling the more valuable pages we find and moving on from there. Specific pages may not be crawled if they have lower quality links on them or appear to be part of an unintentional link farm (for example, things like programmed calendars). If you’re wondering why we’re not identifying links to your site, I would suggest checking to make sure we’ve indexed the sites and pages you know are linking to your site.

                    Also, it’s important to keep in mind that with Link Explorer, new data is added all the time, so please keep an eye out for new data to be available for your site!

                    I hope this helps - please let me know if you have any other questions!

                    Expansyon 1 Reply Last reply Reply Quote 1
                    • Expansyon
                      Expansyon @samantha.chapman last edited by

                      Thank you very much for your response, the truth is that we are appearing in different advertising media, and google has the links indexed. In fact we have now added the url to our moz profile and added it to the Link Tracking Lists tool.

                      It will be a matter of time

                      1 Reply Last reply Reply Quote 0
                      • 1 / 1
                      • First post
                        Last post
                      • Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
                        KPMG-Search-Social
                        KPMG-Search-Social
                        1
                        6
                        91

                      • TLD Change
                        SamFanatic
                        SamFanatic
                        0
                        3
                        82

                      • 612 : Page banned by error response for robots.txt
                        tawnycase
                        tawnycase
                        0
                        8
                        139

                      • Change in OSE?
                        Hurf
                        Hurf
                        0
                        2
                        66

                      • Why doesn't Moz crawler follow robots.txt?
                        Tylerj
                        Tylerj
                        0
                        10
                        879

                      • Why I am not seeing any inbound link to my website?
                        MattAntonino
                        MattAntonino
                        0
                        3
                        158

                      • Moz crawler showing pages blocked by robots.txt
                        DirkC
                        DirkC
                        0
                        4
                        724

                      • I have a robots.txt error on Moz but not on Google Webmaster tools. Wondering what to do.
                        Linda-Vassily
                        Linda-Vassily
                        0
                        2
                        572

                      Get started with Moz Pro!

                      Unlock the power of advanced SEO tools and data-driven insights.

                      Start my free trial
                      Products
                      • Moz Pro
                      • Moz Local
                      • Moz API
                      • Moz Data
                      • STAT
                      • Product Updates
                      Moz Solutions
                      • SMB Solutions
                      • Agency Solutions
                      • Enterprise Solutions
                      • Digital Marketers
                      Free SEO Tools
                      • Domain Authority Checker
                      • Link Explorer
                      • Keyword Explorer
                      • Competitive Research
                      • Brand Authority Checker
                      • Local Citation Checker
                      • MozBar Extension
                      • MozCast
                      Resources
                      • Blog
                      • SEO Learning Center
                      • Help Hub
                      • Beginner's Guide to SEO
                      • How-to Guides
                      • Moz Academy
                      • API Docs
                      About Moz
                      • About
                      • Team
                      • Careers
                      • Contact
                      Why Moz
                      • Case Studies
                      • Testimonials
                      Get Involved
                      • Become an Affiliate
                      • MozCon
                      • Webinars
                      • Practical Marketer Series
                      • MozPod
                      Connect with us

                      Contact the Help team

                      Join our newsletter
                      Moz logo
                      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                      • Accessibility
                      • Terms of Use
                      • Privacy