The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Site scraped over 400,000 urls

    Site scraped over 400,000 urls

    Technical SEO Issues
    3 3 91
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Kibin
      Kibin last edited by

      Our business is heavily dependent on SEO traffic from long tail search. We have over 400,000 pieces of content, all of which we found scraped and published by another site based out of Hong Kong (we're in the US).

      Google has a process for DMCA takedown, but doing so would be beyond tedious for such a large set of urls. The scraped content is outranking us in many searches and we've noticed a drastic decrease in organic traffic, likely from a duplicate content penalty.

      Has anyone dealt with an issue like this? I can't seem to find much help online.

      1 Reply Last reply Reply Quote 0
      • KinsellaTax
        KinsellaTax last edited by

        This post is deleted!
        1 Reply Last reply Reply Quote 0
        • Nigel_Carr
          Nigel_Carr last edited by

          Hi Kibin

          Firstly it's unlikely that their scraped content will affect your rankings - Google generally knows who originated it. However:

          Do you have the hreflang tag on your website? specifying your language and location? If theirs has this as well then technically you are targetting a different country, so there should be no duplicate content if you added it.

          https://support.google.com/webmasters/answer/189077?hl=en

          I would tell Google about the URL and add a sample 10 URLs first: https://www.google.com/webmasters/tools/dmca-dashboard. Telling them is an absolute must even if it's only a few URLs.

          Also email the hosting company informing them that they are hosting copied content and that the penalties are severe.

          Finally, write to the company themselves and tell them/warn them that you are going legal and send them a cease and desist legal letter. I am sure you can knock one up for a few dollars from a friendly solicitor.

          Watch this: https://www.youtube.com/watch?v=gGc_jc3Oznk It's a bit long but worth it.

          Do all of these things.

          Regards

          Nigel

          1 Reply Last reply Reply Quote 2
          • 1 / 1
          • First post
            Last post
          • If I want clean up my URLs and take the "www.site.com/page.html" and make it "www.site.com/page" do I need a redirect?
            Booj
            Booj
            0
            4
            113

          • We have designed a new site and are in dilemna whether or not to change the site's URL structure or maybe few odd looking urls. How exactly do we go about the URL thing in toto? thanks in advance, any suggestion(s) would be dearly welcome
            ShaunPhilips
            ShaunPhilips
            1
            7
            109

          • URL Changes And Site Map Redirects
            Chris.Menke
            Chris.Menke
            0
            2
            71

          • Friendly URLs for MultiLingual Site
            wissamdandan
            wissamdandan
            0
            2
            106

          • Best practice for eCommerce site migration, should I 301 redirect or match URLs on new site
            Jinx14678
            Jinx14678
            0
            4
            1.2k

          • Crawl reveals hundreds of urls with multiple urls in the url string
            irvingw
            irvingw
            0
            5
            455

          • Should we introduce subfolders into the URLs on a new site?
            oneresult
            oneresult
            0
            2
            515

          • Canonical URLs and screen scraping
            friendlymachine
            friendlymachine
            0
            5
            1.2k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy