The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Other Websites Crawling my Site using WordPress/3.1 bot?

    Other Websites Crawling my Site using WordPress/3.1 bot?

    Technical SEO Issues
    4 2 660
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Trigun
      Trigun last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • AlanMosley
        AlanMosley last edited by

        Well if they obay robots you cn try

        disallow WordPress

        Other than that use a canonical tag in all pages, so that when the scapper uses the pages they point back to you. Even if he notices, you have caused him to do a bit extra work.

        Trigun 1 Reply Last reply Reply Quote 0
        • Trigun
          Trigun @AlanMosley last edited by

          Hi,

          Thanks for the reply.  I have canonical tag in all my pages.  The thing is,  when they start to scrape my posts,  even just the part before the tag of my content,  google gives them higher rankings than mine.

          AlanMosley 1 Reply Last reply Reply Quote 0
          • AlanMosley
            AlanMosley @Trigun last edited by

            Report them to google as a spam site

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Should you use robots.txt for pages within your site which do not have high quality content or are not contributing a great deal so when Google crawls your site the best performing content has a higher chance of being indexed?
              Jacksons_Fencing
              Jacksons_Fencing
              0
              5
              44

            • Why does my site have so many crawl errors relating to the wordpress login / captcha page
              ZenyaS
              ZenyaS
              0
              6
              88

            • Could using our homepage Google +1's site wide harm our website?
              EricaMcGillivray
              EricaMcGillivray
              0
              6
              126

            • My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
              Vuly
              Vuly
              0
              5
              1.6k

            • Will sitemap generated in Yoast for a combined wordpress/magento site map entire site ?
              Dan-Lawrence
              Dan-Lawrence
              0
              5
              1.4k

            • How to link site.com/blog or site.com/blog/
              matbennett
              matbennett
              0
              2
              107

            • Have a client that migrated their site; went live with noindex/nofollow and for last two SEOMoz crawls only getting one page crawled. In contrast, G.A. is crawling all pages. Just wait?
              Nobody1560986989723
              Nobody1560986989723
              0
              5
              422

            • Bots gone from site for 1-2 hours
              NakulGoyal
              NakulGoyal
              0
              2
              320

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy