The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Why is Amazon crawling my website? Is this hurting us?

    Why is Amazon crawling my website? Is this hurting us?

    Intermediate & Advanced SEO
    4 4 677
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Ty1986
      Ty1986 last edited by

      Hi mozzers,

      I  discovered that Amazon is crawling our site and exploring thousands of profile pages. In a single day it crawled 75k profile pages.

      1. Is this related to AWS?
      2. Is this something we should worry about or not?  If so what could be a solution to counter this?
      3. Could this affect our Google Analytics organic traffic?
      1 Reply Last reply Reply Quote 0
      • KevinBudzynski
        KevinBudzynski last edited by

        1. Is this related to AWS? Yes, most likely a customer on AWS scraping your site.
        2. Is this something we should worry about or not?  If so what could be a solution to counter this? Monitor it. If the crawling get's ridiculous, you could have site performance issues. Could deny IP addresse(s) in .htacces or try via Robot.txt file.
        3. Could this affect our Google Analytics organic traffic? If your site performance suffers, could affect organic position and decrease traffic.

        Good luck!

        1 Reply Last reply Reply Quote 0
        • mian183
          mian183 last edited by

          this is not about moz

          1 Reply Last reply Reply Quote 0
          • oxidants
            oxidants last edited by

            My website https://www.avenuessouthresidences.com also has traffic coming from Amazon bots. I wonder if it's my competitors doing something funny or it's Amazon itself doing it.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • When I crawl my website I have urls with (#!162738372878) at the end of my urls
              Matt16
              Matt16
              0
              3
              44

            • If my website do not have a robot.txt file, does it hurt my website ranking?
              Alick300
              Alick300
              0
              2
              242

            • Why doesn't my website crawl by Google?
              LoganRay
              LoganRay
              0
              8
              82

            • Do 403 Forbidden errors from website pages hurt rankings?
              OlegKorneitchouk
              OlegKorneitchouk
              0
              6
              4.7k

            • Is there a difference between .us and .org for a website targetting the US market?
              MikeGracia
              MikeGracia
              0
              5
              704

            • Are links to our website through our affiliate program hurting our rankings?
              youngb55
              youngb55
              0
              4
              471

            • New to SEO. Are there any technical issues on my website that is hurting my SEO?
              danatanseo
              danatanseo
              0
              2
              328

            • Website Crawl problems
              MoosaHemani
              MoosaHemani
              0
              3
              442

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy