The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Behavior & Demographics
    4. Blocking links from being crawled

    Blocking links from being crawled

    Behavior & Demographics
    16 6 270
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • evolvingSEO
      evolvingSEO @uesat last edited by

      Penguin 2.0 is definitely from webspam and backlinks. I suggest using Google Webmaster Tools as your backlink dataset. They provide links that are more likely to be causing problems. It's extremely unlikely the internal links are hurting you if it is Penguin 2.0.

      uesat 1 Reply Last reply Reply Quote 1
      • evolvingSEO
        evolvingSEO @David_ODonnell last edited by

        I agree with David here. Someone made a custom category plugin for WordPress which will do what David is suggesting. I would not block anything, but rather noindex what you don't want in the index, which is typically for me tags, subpages, author and date archives.

        -Dan

        1 Reply Last reply Reply Quote 1
        • uesat
          uesat @evolvingSEO last edited by

          I used Google Webmaster tools and I used Site Explorer to try and find the spam.  From Webmaster tools was where I found that 50% of all my backlinks came from just 1 site.  But this also happens to be the strongest relevant site I could get backlinks from.  Is this something that Penguin penalizes you for?  The fact that most links are coming from just 1 website?

          evolvingSEO 1 Reply Last reply Reply Quote 0
          • evolvingSEO
            evolvingSEO @uesat last edited by

            It depends. If the sitewide links were;

            • off topic from the site it was on, not as relevant
            • among a giant list of other "blogroll" links
            • on a site that may have a penalty against it
            • exact match commercial anchor text <--big one
            • if it's part of a "link exchange"

            Those issues could hurt you coming from one site. If the links were exact match commercial anchors I'd see about changing them to brand or domain name anchors. If the site linking to you is a random topic, or you're among a big giant list of links, or part of a link exchange get the links removed or disavow.

            -Dan

            ALLee uesat 2 Replies Last reply Reply Quote 0
            • ALLee
              ALLee @evolvingSEO last edited by

              agree with Dan. If it's not any of the above and you are sure none of the other links are spam, you might not have been hit with penguin 2.0, but some other penalty.

              I would check with other tools as well. Use as many tools you have at your disposal and create a comprehensive list of backlinks.

              uesat 1 Reply Last reply Reply Quote 0
              • uesat
                uesat @evolvingSEO last edited by

                Dan,

                The website's topic is very similar to mine.  The link was part of a blogroll of about 15 other sites.  The anchor text was my website name.  For example, if my website were www.cleanbluecars.com, the anchor was Clean Blue Cars.  Maybe Google is considering that to be an exact match commercial anchor text?

                The websites on that blogroll were not part of a link exchange, but some of the websites on that blogroll mention the main website on their blog.  The main website hosts a blog carnival every Monday so people naturally mention it.  The main website was who put me on its blogroll because I normally participate on their weekly blog carnival.  The carnival links are and have always been no-follow.

                evolvingSEO 1 Reply Last reply Reply Quote 0
                • uesat
                  uesat @ALLee last edited by

                  Alicia,

                  I was hit by penguin 2.0.  There's no question about it

                  1 Reply Last reply Reply Quote 0
                  • evolvingSEO
                    evolvingSEO @uesat last edited by

                    Thanks for the details. It may not be those links, but if there were even a few others, it could potentially hurt the site. I had a client who had done some spammy link building in 2011ish with another agency and just those few links hurt the site. I would try removing or disavowing anything you can find that's spammy, and not helping, and see if they helps anything.

                    The types of things to de-optimize on your own site would be more like keyword stuffing in the titles, URLs, headers and internal anchors - not so much blocking pages from being crawled. Blocking crawling it typically only if you want to improve crawl efficiency on really large sites or you just don't want Google to page attention to that content, but it won't fix a Penguin issue if it's on-site.

                    -Dan

                    uesat 1 Reply Last reply Reply Quote 1
                    • uesat
                      uesat @evolvingSEO last edited by

                      Thanks Dan.  Just to be clear, what do you mean by this "It may not be those links, but if there were even a few others, it could potentially hurt the site."  You mean blogroll links in other sites?  I have 82 links from Woorank.  I did not ask them to put me there and I didnt even know who they were until I saw them on webmaster tools.  They're unrelated to my niche but they're not a bad quality site.  Could they hurt my site?

                      I did have spammy unrelated links from 3 other websites.  But that's it.  I have a few links from general topic websites and most of my links are from relevant sites.  I'm also on another blogroll from a relevant site, just not as big as the one I mentioned.

                      evolvingSEO 1 Reply Last reply Reply Quote 0
                      • evolvingSEO
                        evolvingSEO @uesat last edited by

                        Hi, sorry... I just meant if you did have a few other spammy links from other sites, those could hurt you. I doubt the woorank ones are hurting, but perhaps the other 3 spammy sites you mentioned could have been.

                        1 Reply Last reply Reply Quote 0
                        • 1 / 1
                        • First post
                          Last post
                        • Help Me With These Horrible Crawl Errors
                          MattRoney
                          MattRoney
                          0
                          8
                          257

                        • Personalised Geo-targeted results - How does Google pass link juice?
                          KristinaKledzik
                          KristinaKledzik
                          0
                          2
                          177

                        • WMT reporting big drop in links today
                          FDFPres
                          FDFPres
                          0
                          3
                          103

                        • How come some local 7 pack listings link to site and some link to the G+ page?
                          LindaBuquet
                          LindaBuquet
                          0
                          8
                          153

                        • Is it my back link profile that is affecting my rankings ?
                          Jeepster
                          Jeepster
                          0
                          5
                          197

                        • How do i know if my links are being classed as spammy?
                          dan.backowski
                          dan.backowski
                          0
                          9
                          316

                        • Gathering Data on Link Removal and Disavow Tool
                          ShaMenz
                          ShaMenz
                          1
                          9
                          1.0k

                        • Google Webmaster Tools notice of detected unnatural links to our website
                          ChrisHolgate
                          ChrisHolgate
                          0
                          3
                          1.1k

                        Get started with Moz Pro!

                        Unlock the power of advanced SEO tools and data-driven insights.

                        Start my free trial
                        Products
                        • Moz Pro
                        • Moz Local
                        • Moz API
                        • Moz Data
                        • STAT
                        • Product Updates
                        Moz Solutions
                        • SMB Solutions
                        • Agency Solutions
                        • Enterprise Solutions
                        • Digital Marketers
                        Free SEO Tools
                        • Domain Authority Checker
                        • Link Explorer
                        • Keyword Explorer
                        • Competitive Research
                        • Brand Authority Checker
                        • Local Citation Checker
                        • MozBar Extension
                        • MozCast
                        Resources
                        • Blog
                        • SEO Learning Center
                        • Help Hub
                        • Beginner's Guide to SEO
                        • How-to Guides
                        • Moz Academy
                        • API Docs
                        About Moz
                        • About
                        • Team
                        • Careers
                        • Contact
                        Why Moz
                        • Case Studies
                        • Testimonials
                        Get Involved
                        • Become an Affiliate
                        • MozCon
                        • Webinars
                        • Practical Marketer Series
                        • MozPod
                        Connect with us

                        Contact the Help team

                        Moz logo
                        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                        • Accessibility
                        • Terms of Use
                        • Privacy