The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawling a subfolder with a dev site

    Crawling a subfolder with a dev site

    Technical SEO Issues
    2 2 359
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Total_Displays
      Total_Displays last edited by

      I am trying to set up a campaign where I am crawling a subfolder of our main site where I have dev version of the new site. However, even though the new site resolves and I have included the full resolving URL but the crawl results come back saying that only one page has been crawled. The site has had a protected block on it for a period of time but this has now been removed.

      Any ideas?

      Thanks

      Nick

      1 Reply Last reply Reply Quote 0
      • KeriMorgret
        KeriMorgret last edited by

        Here's a post with the common reasons why you get that error. https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages

        If that doesn't solve the problem, contact the help team at help@seomoz.org.

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Site Migration from One Dev. and Server to Another Dev. and Server
          LoganRay
          LoganRay
          0
          10
          245

        • Site Crawling with Firewall Plugin
          RyanPurkey
          RyanPurkey
          0
          4
          128

        • My site is not being regularly crawled?
          Everett
          Everett
          0
          5
          138

        • Seomoz Can not Crawl My Site
          AndreVanKets
          AndreVanKets
          0
          2
          112

        • Site Crawl
          Sean_Dawes
          Sean_Dawes
          0
          2
          414

        • Should we introduce subfolders into the URLs on a new site?
          oneresult
          oneresult
          0
          2
          515

        • Site maintenance and crawling
          Daylan
          Daylan
          1
          3
          451

        • Recently revamped site structure - now not even ranking for brand name, but lots of content - what happened? (Yup, the site has been crawled a few times since) Any ideas? Did I make a classic mistake? Any advise appreciated :)
          AlanBleiweiss
          AlanBleiweiss
          0
          9
          844

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy