The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Educational Resources
    4. How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?

    How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?

    Educational Resources
    2 2 130
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PracticalActionDigital
      PracticalActionDigital last edited by

      We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines.  Would dofollow and noindex sequence work ?

      1 Reply Last reply Reply Quote 0
      • effectdigital
        effectdigital last edited by

        Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results

        Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)

        Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:

        https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file

        This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Backlink From Different Language Sites Will Spoil My Ranking?
          benesmartin
          benesmartin
          1
          5
          2.7k

        • Can you have same product name and description on a local and national site at the same time without getting dinged by google?
          gazzerman1
          gazzerman1
          0
          2
          250

        • Google Analytics setup tips and tricks?
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          2
          7
          212

        • Why update your site
          donford
          donford
          0
          3
          328

        • Remove image URL from a google crawl
          tomcraig86
          tomcraig86
          0
          2
          521

        • Top Domain Authority Sites
          globallike
          globallike
          0
          5
          16.0k

        • Does Server Speed Effect SEO Rankings?
          chronicle
          chronicle
          0
          10
          2.4k

        • Does more high traffic to your website increase your rankings?
          Dekoda_Jones
          Dekoda_Jones
          0
          5
          3.0k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy