The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Page that has no link is being crawled

    Page that has no link is being crawled

    Technical SEO Issues
    4 2 989
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 13375auc3
      13375auc3 last edited by

      http://www.povada.com/category/filters/metal:Silver/nstart/1/start/1.htm

      I have no idea how the above page was even found by google but it seems that it is being crawled and Im not sure where its being found from.

      Can anyone offer a solution?

      1 Reply Last reply Reply Quote 0
      • TellThemEverything
        TellThemEverything last edited by

        What's the problem that you need a solution to? If you dont want it indexed, add a noindex meta tag:

        <meta name="robots" content="noindex" />
        
        13375auc3 1 Reply Last reply Reply Quote 0
        • 13375auc3
          13375auc3 @TellThemEverything last edited by

          I don't understand how googlebot is finding this page. I didn't even know it existed. Should I stop my website from generating these generic pages? They have no value to me whatsover, and are also a duplicate content problem.

          And if I do, what is the best way of handling a page that a crawler may try to access? A 301 redirect? And to where would I redirect if there are no similar pages like this.

          TellThemEverything 1 Reply Last reply Reply Quote 0
          • TellThemEverything
            TellThemEverything @13375auc3 last edited by

            There are numerous ways for google to find your URL even if it doesnt have a regular link to it - security by obscurity isnt very effective, if you truly dont want anything to be crawled hide it behind a login.

            I'm not sure how these pages are being created obviously but I wouldnt redirect - instead remove them from index using meta tag or robots.txt. Or just delete them 🙂

            1 Reply Last reply Reply Quote 2
            • 1 / 1
            • First post
              Last post
            • "One Page With Two Links To Same Page; We Counted The First Link" Is this true?
              Fuel
              Fuel
              0
              5
              407

            • Should I consider webmaster tools links and linked pages ratio to remove unnatural links?
              Cyrus-Shepard
              Cyrus-Shepard
              0
              3
              188

            • No crawl code for pages of helpful links vs. no follow code on each link?
              GeorgeAndrews
              GeorgeAndrews
              0
              4
              338

            • 2 links on home page to each category page ..... is page rank being watered down?
              QubaSEO
              QubaSEO
              0
              6
              436

            • Page crawling is only seeing a portion of the pages. Any Advice?
              KeriMorgret
              KeriMorgret
              0
              5
              371

            • Diagnostic says too many links on a page and most of the pages are from blog entries. Are tags considered links? How do I decrease links?
              AlanMosley
              AlanMosley
              0
              2
              440

            • Does Google pass link juice a page receives if the URL parameter specifies content and has the Crawl setting in Webmaster Tools set to NO?
              Jen_Floyd
              Jen_Floyd
              0
              13
              2.2k

            • Too many on page links for WP blog page
              mozUser1469236629285
              mozUser1469236629285
              0
              9
              684

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy