The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. How can you set SEOmoz to work with your dev site behind an htpasswd?

    How can you set SEOmoz to work with your dev site behind an htpasswd?

    Moz Tools
    4 3 424
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dseo241
      dseo241 last edited by

      All sites need to be developed from the small to the grand - and this takes time. Development usually takes place on a subdomain different from our live domain. It is locked down behind an htpasswd during development so its not picked up by searching engines - that may create duplicate content issues if when the site goes live it has already scanned our site on the development server. Its also a security implementation to keep the site away from prying eyes before its ready for launch There could be security holes that have not been tweaked.

      Whats the best strategy to get SEOmoz involved in this scenario. Its tools are invaluable to the SEO part of the build - but the seomoz crawler bot has a different IP address  (being cloud based) - so we cannot just let a single IP address through our htpasswd.

      Also is there a way to link the dev and live site in seomoz - so when it goes live to maintain all teh same logs without having to create two seperate site campaigns?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • ShaMenz
        ShaMenz last edited by

        Hi dseo241,

        Given that your question specifically relates to Roger's ability to access your sites (both dev & production), I think you would be best to email the SEOmoz Help Team direct - help at seomoz.org.

        I use the stand alone Crawl Test tool to run a base crawl of our dev sites, which are noindexed, but not behind an htpassword, so you would still need to ask the Help Team about accessibility. Incidentally, the SEOmoz User-agent is rogerbot.

        Hope that helps,

        Sha

        RobertFisher 1 Reply Last reply Reply Quote 1
        • RobertFisher
          RobertFisher @ShaMenz last edited by

          Good answer there Sha. Glad to see your smiling face, thought you were hiding! Hope all is well down under.

          ShaMenz 1 Reply Last reply Reply Quote 0
          • ShaMenz
            ShaMenz @RobertFisher last edited by

            Hey Robert!

            Yes, everything is good here, thanks. Just been hectic around here lately and yes, I've been feeling bad about missing my time in Q&A 😞

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • SEOmoz crawler not crawling my site
              IMM
              IMM
              0
              5
              787

            • I can't see my SEOMoz toolabr but my computer settings say that it's enabled. What do i do to fix that?
              Mike.Goracke
              Mike.Goracke
              0
              2
              85

            • Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz.
              Smcnelley
              Smcnelley
              0
              4
              341

            • I am trying to find inbound links for one of my site urls. My question is does SEOMoz able to track all internal links as the Open Site Explorer shows 0 internal links?
              Jeepster
              Jeepster
              0
              4
              492

            • Does SEOmoz work for fully secure sites (https)?
              MeganSingley
              MeganSingley
              0
              6
              813

            • SEOMOZ can we trust you?
              EmpireSEO
              EmpireSEO
              1
              7
              1.1k

            • Open Site Explorer Not Working on 99% of Sites
              randfish
              randfish
              1
              5
              753

            • I put a crawl on my site via seomoz and has come back saying only 1 page has been crawled.It has been over a week now can anyone help?
              jaytwotwenty
              jaytwotwenty
              0
              3
              739

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy