The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Crawling a website with redirects

    Crawling a website with redirects

    Moz Tools
    2 2 535
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Cegeka
      Cegeka last edited by

      Hi,

      I started a campaign for a website which uses multiple redirects before showing the real content.  in the crawling report only one page is crawled.

      Is there a way to let the crawler pass the redirects to get usefull reports?

      The website is www.cegeka.be

      Thank you

      1 Reply Last reply Reply Quote 0
      • heatherrobinson
        heatherrobinson last edited by

        Hi Peter

        It would be helpful to know how you are redirecting these pages (301 etc) and for what reason?

        Also whether any of your pages are blocked in your robots.txt file - perhaps to prevent duplicate content?

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • WEbsite cannot be crawled
          Roman-Delcarmen
          Roman-Delcarmen
          0
          2
          189

        • Crawl findings 301 redirects I didn't make?
          TrentDrake
          TrentDrake
          0
          3
          104

        • Is there a way you can determine the time SEOMoz crawls your website
          ChiarynMiranda
          ChiarynMiranda
          0
          4
          258

        • How long does it take for a campaign website crawl to be completed?
          Discountvc
          Discountvc
          0
          7
          734

        • Why is the SEOmoz crawler crawling the old version of our website?
          Gestisoft-Qc
          Gestisoft-Qc
          0
          4
          801

        • My website has 18500 pages but my SEO MOZ campaign is limited to a 10,000 page crawl. How can I get the other 8500 pages crawled? Can I use one of my 3 spare campaigns?
          kenneth_martin
          kenneth_martin
          0
          5
          1.0k

        • Crawl Rate for Lower Page Authority Websites
          RyanKent
          RyanKent
          0
          2
          1.3k

        • Crawl test. Bot crawled only 200 or so links when it should have crawled thousands
          Ev84
          Ev84
          0
          9
          1.2k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy