The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. SEO Web Crawler IP addresses

    SEO Web Crawler IP addresses

    Moz Tools
    2 2 1.6k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sfchronicle
      sfchronicle last edited by

      What are the IP addresses for the SEO Web Crawler?

      There is a firewall on my clients website before it goes live, I would like to crawl the site before it goes live, but need to provide the web crawlers IP addreses.

      Thank you for your time

      1 Reply Last reply Reply Quote 1
      • MeganSingley
        MeganSingley last edited by

        Hi Jason,

        This is Megan from the SEOmoz Help Team.  Unfortunately, since we crawl from the cloud, RogerBot's IP address is changing all of the time so we cannot specify a particular IP address.  Also, we do need the site to be live before we can crawl it, but you could remove the firewall and block all other bots except rogerbot so it won't get indexed anywhere else before it's ready.

        I hope this helps!  Please let me know if you have any other questions.

        1 Reply Last reply Reply Quote -1
        • 1 / 1
        • First post
          Last post
        • Web Site Migration Testing and SEO-QA Automation?
          adammason
          adammason
          0
          9
          2.2k

        • IP TRACKING
          Reinhart
          Reinhart
          0
          4
          185

        • Can I base a SEO campaign on a specific MLS listing inteads of full broker web site?
          pd2012
          pd2012
          0
          7
          602

        • Rel Canonical issues for two urls sharing same IP address
          GravitateOnline
          GravitateOnline
          0
          3
          1.3k

        • Is having the company's address in the footer (or header) of each webpage important for SEO?
          Hallam
          Hallam
          0
          4
          2.6k

        • Is there a whitelist of the RogerBot IP Addresses?
          chill986
          chill986
          1
          8
          3.7k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy