The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Seomoz Spider/Bot Details

    Seomoz Spider/Bot Details

    Moz Tools
    5 3 3.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • blagger
      blagger last edited by

      Hi All

      Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place.

      The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the  list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors.

      Thanks

      1 Reply Last reply Reply Quote 1
      • AlanMosley
        AlanMosley last edited by

        Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot)

        HalogenDigital 1 Reply Last reply Reply Quote 2
        • AlanMosley
          AlanMosley last edited by

          3 dots placed before last bracket, need to be removed,

          blagger 1 Reply Last reply Reply Quote 0
          • blagger
            blagger @AlanMosley last edited by

            Thanks Alan. much appreciated.

            1 Reply Last reply Reply Quote 0
            • HalogenDigital
              HalogenDigital @AlanMosley last edited by

              An old answer to an old question, but one which has just helped me out tremendously. A true credit to the Q&A system!

              1 Reply Last reply Reply Quote 1
              • 1 / 1
              • First post
                Last post
              • Why SEOmoz bot consider these as duplicate pages?
                fablau
                fablau
                0
                29
                291

              • Update in Moz spider/tools?? Flagging duplicate content / ignoring canonical
                ChiarynMiranda
                ChiarynMiranda
                0
                8
                538

              • Where is the labs LDA topics tool? The articles mentioning it point to http://www.seomoz.org/labs/lda but that forwards me to the tools landing page.
                bluenote
                bluenote
                0
                3
                1.5k

              • How many campaigns I can run on SEOmoz software in $99/ month?
                RobertFisher
                RobertFisher
                0
                2
                526

              • Does SEOmoz have a keyword visibility report / tool?
                Cyrus-Shepard
                Cyrus-Shepard
                0
                2
                2.1k

              • SEOMoz Campaigns: Bulk management / deletion of keywords?
                Wootpop
                Wootpop
                0
                3
                1.0k

              • Http://lsapi.seomoz.com pop up
                KeriMorgret
                KeriMorgret
                0
                4
                4.8k

              • What is the difference between followed/no followed/ internal/ external links? And how do i improve them?
                AndreVanKets
                AndreVanKets
                0
                2
                751

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy