The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Page that has no link is being crawled

    Page that has no link is being crawled

    Technical SEO Issues
    4 2 989
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 13375auc3
      13375auc3 last edited by

      http://www.povada.com/category/filters/metal:Silver/nstart/1/start/1.htm

      I have no idea how the above page was even found by google but it seems that it is being crawled and Im not sure where its being found from.

      Can anyone offer a solution?

      1 Reply Last reply Reply Quote 0
      • TellThemEverything
        TellThemEverything last edited by

        What's the problem that you need a solution to? If you dont want it indexed, add a noindex meta tag:

        <meta name="robots" content="noindex" />
        
        13375auc3 1 Reply Last reply Reply Quote 0
        • 13375auc3
          13375auc3 @TellThemEverything last edited by

          I don't understand how googlebot is finding this page. I didn't even know it existed. Should I stop my website from generating these generic pages? They have no value to me whatsover, and are also a duplicate content problem.

          And if I do, what is the best way of handling a page that a crawler may try to access? A 301 redirect? And to where would I redirect if there are no similar pages like this.

          TellThemEverything 1 Reply Last reply Reply Quote 0
          • TellThemEverything
            TellThemEverything @13375auc3 last edited by

            There are numerous ways for google to find your URL even if it doesnt have a regular link to it - security by obscurity isnt very effective, if you truly dont want anything to be crawled hide it behind a login.

            I'm not sure how these pages are being created obviously but I wouldnt redirect - instead remove them from index using meta tag or robots.txt. Or just delete them 🙂

            1 Reply Last reply Reply Quote 2
            • 1 / 1
            • First post
              Last post
            • Transferring link juice on a page with over 150 links
              flo2
              flo2
              0
              5
              205

            • Pages with Duplicate Page Content Crawl Diagnostics
              evolvingSEO
              evolvingSEO
              0
              6
              243

            • Have a client that migrated their site; went live with noindex/nofollow and for last two SEOMoz crawls only getting one page crawled. In contrast, G.A. is crawling all pages. Just wait?
              Nobody1560986989723
              Nobody1560986989723
              0
              5
              422

            • Nofollow links if you have more than one link on a page to the same destination.
              InteractiveRed67
              InteractiveRed67
              0
              3
              399

            • Page crawling is only seeing a portion of the pages. Any Advice?
              KeriMorgret
              KeriMorgret
              0
              5
              371

            • Does Google pass link juice a page receives if the URL parameter specifies content and has the Crawl setting in Webmaster Tools set to NO?
              Jen_Floyd
              Jen_Floyd
              0
              13
              2.2k

            • If two links from one page link to another, how can I get the second link's anchor text to count?
              RyanKent
              RyanKent
              0
              2
              720

            • Too many on page links for WP blog page
              mozUser1469236629285
              mozUser1469236629285
              0
              9
              684

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy