The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Online Marketing Tools
    4. What is the name of BrightEdge's crawler?

    What is the name of BrightEdge's crawler?

    Online Marketing Tools
    2 2 351
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • QLP2004
      QLP2004 last edited by

      Any help would be much appreciated 🙂

      I can't seem to find this one myself.

      1 Reply Last reply Reply Quote 0
      • GastonRiera
        GastonRiera last edited by

        Hi there,

        If you can't find it online. You can always check on your log files.
        Ask your hosting provider or talk to your infrastructure team so as they can help you.

        What you need is 4 columns: date, user-agent, its IP and requested-url.
        Why IP is needed? Some crawlers try to hide under GoogleBot user-agent. Just take a few IPs and with a simple DNS lookup, you'll know which aren't google's.
        PRO tip:
        Windows, CMD console: nslookup [IP address]
        Linus, terminal: nslookup [IP address]

        Hope it helps.
        Best luck.
        GR

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Does the Google News 'Editor's Picks' benefit SEO?
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          0
          2
          197

        • Alternatives to SEO Book's Rank Checker
          VanguardCommunications
          VanguardCommunications
          0
          13
          3.5k

        • Our website's index page is fluctuating in Google SERPs
          skalfa
          skalfa
          0
          5
          449

        • What do you think about Copyblogger's Authority Program?
          0
          1
          626

        • What's the difference between ebook and PDF?
          Rubix
          Rubix
          0
          3
          12.2k

        • Crunchbase - How much does it improve a company's SEO?
          bradkrussell
          bradkrussell
          0
          3
          3.2k

        • Looking for good ways to earn a customer's trust
          DavidKonigsberg
          DavidKonigsberg
          0
          6
          439

        • What's your favorite feed publishing tool and why?
          EGOL
          EGOL
          0
          2
          373

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy