The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Can SEOMoz crawl a single page as oppose to an entire subfolder?

    Can SEOMoz crawl a single page as oppose to an entire subfolder?

    Technical SEO Issues
    6 2 318
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • OBIAnalytics
      OBIAnalytics last edited by

      I would like the following page to be crawled:

      http://www.ob.org/_programs/water/water_index.asp

      Instead, SEOMoz changes the page to the following subfolder which is an invalid url:

      http://www.ob.org/_programs/water/

      1 Reply Last reply Reply Quote 0
      • CollinJarman
        CollinJarman last edited by

        According to their "Set up a Campaign" page, subfolder is as specific as it gets.  They mention that the subfolder must be resolved in order to be crawled.

        Alternatively, if you're mainly interested in on-page items, you can use the "on-page optimization" tool under "Research Tools" to grade specific pages on keywords.  Though I would suggest just resolving your .../water/ to actually show a page, then crawl the whole subfolder.

        OBIAnalytics 1 Reply Last reply Reply Quote 0
        • OBIAnalytics
          OBIAnalytics @CollinJarman last edited by

          Hi Collin.

          Thanks for your feedback. Now when say "resolve", what does that actually mean?

          CollinJarman OBIAnalytics 3 Replies Last reply Reply Quote 0
          • CollinJarman
            CollinJarman @OBIAnalytics last edited by

            By Resolve, I mean that the URL in question actually needs to end up showing the user content and not be a blocked page.

            If you go to this address:

            http://www.ob.org/_programs/water/

            it gets a 403 server error.  I'm not sure how SEOmoz handles this, but my gut tells me you'd probably be safe to just 301 redirect that URL to the following:

            http://www.ob.org/_programs/water/water_index.asp

            However, if that doesn't work, you will need to add content to and allow users to browse that specific page.

            1 Reply Last reply Reply Quote 1
            • OBIAnalytics
              OBIAnalytics @OBIAnalytics last edited by

              Collin,

              The address:

              http://www.ob.org/_programs/water/

              is an invalid link that does not exist - it's something that SEOMoz created, assuming that the valid link, which is a single page, is under that subfolder. So what you suggest is creating a redirect from the invalid link to the single page, correct?

              1 Reply Last reply Reply Quote 0
              • CollinJarman
                CollinJarman @OBIAnalytics last edited by

                Yes.  I think that will solve your problem.

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Can Google Crawl This Page?
                  N1ghteyes
                  N1ghteyes
                  0
                  4
                  263

                • How can I fix this home page crawl error ?
                  JaneCopland
                  JaneCopland
                  0
                  8
                  1.2k

                • Can Googlebot crawl the content on this page?
                  danatanseo
                  danatanseo
                  0
                  7
                  156

                • I have 3500 pages crawled by Google, - why is SEOMOZ only able to crawl 400 of these ?
                  Abe_Schmidt
                  Abe_Schmidt
                  0
                  2
                  95

                • Seomoz Can not Crawl My Site
                  AndreVanKets
                  AndreVanKets
                  0
                  2
                  112

                • Can I crawl a password protected domain with SEOmoz?
                  TommyTan
                  TommyTan
                  0
                  2
                  325

                • While SEOMoz currently can tell us the number of linking c-blocks, can SEOMoz tell us what the specific c-blocks are?
                  CMC-SD
                  CMC-SD
                  0
                  2
                  292

                • Can I use canonical tags to merge property map pages and availability pages to their counterpart overview pages?
                  AlanBleiweiss
                  AlanBleiweiss
                  0
                  5
                  784

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy