The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Working around Dev Site

    Working around Dev Site

    Intermediate & Advanced SEO
    4 4 106
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • atlanticocean
      atlanticocean last edited by

      I am working around development site. All pages are 'nofollow'. What can I advice on, when it come to SEO and is there any good article or checklist that I can go through.

      One thing I wanted to know is how can I check for broken links or meta data or any other SEO analytics if the page is 'nofollow' and I cannot crawl it with screaming frog or any other tools.

      1 Reply Last reply Reply Quote 0
      • LynnPatchett
        LynnPatchett last edited by

        HI,

        For screaming frog there is an option in the config -> spider menu that says 'follow internal nofollow'. Checking that box should allow you to crawl the site.

        1 Reply Last reply Reply Quote 2
        • Martijn_Scheijbeler
          Martijn_Scheijbeler last edited by

          Hi George,

          Maybe in addition to that make sure you have to enter HTTP Authentication to make sure that none of the pages on the domain are being crawled. Besides that I would indeed go with the recommendation from Lynn.

          1 Reply Last reply Reply Quote 1
          • MattRoney
            MattRoney last edited by

            As for an SEO checklist, I'd suggest the Web Developer's Cheat Sheet. It's a good idea to read the Beginner's Guide to SEO, too. 🙂

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Is it posible to improve site rankings working only with an other site?
              webtematica
              webtematica
              0
              3
              91

            • Linking to one of my own sites, from my site
              EricaMcGillivray
              EricaMcGillivray
              0
              3
              178

            • How did my dev site end up in the search results?
              MattRoney
              MattRoney
              0
              13
              144

            • How to make sure dev site is not index in wordpress and how would it be affected?
              Stevejacobsen
              Stevejacobsen
              0
              8
              487

            • Dev Site Out of SERP But Still Indexed
              RobMay
              RobMay
              0
              6
              145

            • Do sites like these really work?
              bradkrussell
              bradkrussell
              0
              11
              814

            • I want some good bookmarking sites to work with.
              matbennett
              matbennett
              0
              6
              1.4k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy