The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Why is the SEOmoz crawler crawling the old version of our website?

    Why is the SEOmoz crawler crawling the old version of our website?

    Moz Tools
    4 3 801
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Gestisoft-Qc
      Gestisoft-Qc last edited by

      Hello,

      I'm a new SEOmoz member.

      On Dec. 2nd, after completely redesigning our website, we migrated to a new hosting company by switching our DNS to the new server.

      The vast majority of the URLs have changed and we configured redirects of the old URLs to the new ones. Although, this task is not completed yet.

      After the migration, I created an account on SEOmoz to be able to track our progress and find the issues to fix to optimize our SEO.

      For some reason, in the SEOmoz reports it is the old URLs that show up. Unless the crawler does not actually crawl the pages and only uses the indexed pages to generate its report, I don't understand how could this possible.

      Anyone has a clue?

      When will the new URLs be indexed by SEOmoz and the major search engines?

      Thanks for your help!

      1 Reply Last reply Reply Quote 0
      • RobertFisher
        RobertFisher last edited by

        Gestisoft-QC

        First, SEOmoz does crawl the site it is not using indexed pages. I am assuming you set this up as a campaign and got the initial report and saw the old urls? If you are looking for links, OSE is different and does take roughly 3 to 7 weeks to show due to the amount of work involved (they are crawling the web as opposed to a site for this).

        I ran your site through Screaming Frog and see the 301's, etc. You might try using Screaming Frog to see the Header Responses, etc. http://www.screamingfrog.co.uk/seo-spider/ Screaming Frog has a free download for windows or Mac and that should be sufficient to see what URLs are showing, etc. It will not give you the other info you get from moz.

        I cannot see where the moz would be different, but this should at least give you a good cross reference.

        If you don't get resolution there, here is the link to helpful info on moz Pro: http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page

        You can also ask for help via help@SEOmoz.org. They are very responsive.

        Hope this helps

        1 Reply Last reply Reply Quote 0
        • Cyrus-Shepard
          Cyrus-Shepard last edited by

          The only way that SEOmoz will crawl your old URLs is if that is what your web servers is delivering to the SEOmoz crawlers. In this case, you might want to make sure all your redirect are in place.

          I did a quick check of the URL listed in your public profile using the tool URI valet, and found at least 4 redirects from the homepage, including a 302, which passes no link juice. This is definitely something you want to look into.

          Generally the SEOmoz robots will crawl your site once a week, so 99% of the time you will see new infomation contained in your campaign within 7-10 day. If you suspect an error, be sure to contact the help team (help@seomoz.org)

          Also, here's my favorite article on site migration. Although you didn't migrate a complete site, many of the principals still apply.

          https://seogadget.co.uk/surviving-seo-site-migration/

          Best of luck with your SEO!

          1 Reply Last reply Reply Quote 1
          • Gestisoft-Qc
            Gestisoft-Qc last edited by

            Thanks for the answers guys.

            @Robert: It is indeed the initial report. Yet I did receive other reports since. Also thanks for suggestion the Screaming Frog tool. The report I get from it will be useful in my discussion with our CRM provider.

            @Cyrus: I also used URI Valet. I don't understand, the 302 redirects are on picture links. I'll communicate with our CRM provider about that. Also, I don't understand how any of our old URLs could be reached crawling our website as this is a completely new website. No part was transferred over so the shouldn't be any way for the crawler to see our old URLs.

            Thanks again

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
              Johnny4B
              Johnny4B
              0
              4
              147

            • SEOmoz crawler not crawling my site
              IMM
              IMM
              0
              5
              787

            • How often does seomoz crawl the site? Can you force a crawl at a specific time ?
              stewbuch1872
              stewbuch1872
              0
              6
              188

            • Is there a way you can determine the time SEOMoz crawls your website
              ChiarynMiranda
              ChiarynMiranda
              0
              4
              258

            • Seomoz crawler problems
              Peterli
              Peterli
              0
              4
              279

            • Only 1 page is being crawled by SEOmoz for the last 2 crawls
              KeriMorgret
              KeriMorgret
              0
              6
              863

            • My website has 18500 pages but my SEO MOZ campaign is limited to a 10,000 page crawl. How can I get the other 8500 pages crawled? Can I use one of my 3 spare campaigns?
              kenneth_martin
              kenneth_martin
              0
              5
              1.0k

            • SEOMoz only crawling 5 pages of my website
              Hurf
              Hurf
              0
              8
              911

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy