The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Xenu Alternative for Large Sites

    Xenu Alternative for Large Sites

    Technical SEO Issues
    3 3 1.8k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • eLocalusa
      eLocalusa last edited by

      We're launching a new site and we're trying to crawl it to check for any problems.  It's millions of pages and Xenu seems to start encountering errors as the numbers mount past 500,000.  Does anyone know of an alternative, free or paid, that could handle the size better?

      1 Reply Last reply Reply Quote 0
      • oneticsoft
        oneticsoft last edited by

        WEB CEO and seopowersuite try them if it doesnt work: google webmaster tools but you will have to wait until it crawls your site, and not last thing seomoz crawling it has 10 000 limit minimum but it will be enougth to detect major problems

        1 Reply Last reply Reply Quote 0
        • KeriMorgret
          KeriMorgret last edited by

          There's a post in the last 24 hours about Xenu and Screaming Frog, it's worth a read to see if a) screaming frog my work for you and b) if the 64 bit version of Xenu mentioned in the comments can solve any problems.

          http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Sitemap use for very large forum-based community site
            GFD_Chris
            GFD_Chris
            0
            3
            59

          • Indexing problem a large site
            Andy-Halliday
            Andy-Halliday
            1
            6
            67

          • Bingbot appears to be crawling a large site extremely frequently?
            danatanseo
            danatanseo
            1
            3
            557

          • Help Crawl friendliness for large site
            TakeshiYoung
            TakeshiYoung
            0
            4
            144

          • How do I find which pages are being deindexed on a large site?
            evolvingSEO
            evolvingSEO
            0
            3
            1.9k

          • Massive Nonsensical 301 on Large ecommerce Site
            Everett
            Everett
            0
            3
            185

          • Onsite SEO Strategy for a large accommodation site
            SCL-SEO
            SCL-SEO
            0
            3
            690

          • Could a large number of No Followed links in to my site have caused a penalty?
            tofftrader
            tofftrader
            0
            3
            468

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy