The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawl Tool Producing Random URL's

    Crawl Tool Producing Random URL's

    Technical SEO Issues
    4 3 692
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • MyNet
      MyNet last edited by

      For some reason SEOmoz's crawl tool is returning duplicate content URL's that don't exist on my website.  It is returning pages like "mydomain.com/pages/pages/pages/pages/pages/pricing"  Nothing like that exists as a URL on my website.  Has anyone experienced something similar to this, know what's causing it, or know how I can fix it?

      1 Reply Last reply Reply Quote 0
      • Seaward-Group
        Seaward-Group last edited by

        I had this weird issue too but it was down to how our developers created the website. Does "mydomain.com/pages/pages/pages/pages/pages/pricing" still take you to the correct page or does it show you a 404 error?

        MyNet 1 Reply Last reply Reply Quote 0
        • MyNet
          MyNet @Seaward-Group last edited by

          Well we have our website setup to where if you type something after mydomain.com/ that is not a valid URL it will take you to the site map.  For example if I typed in mydomain.com/ljlksdfsdfkjsdlfjsflj it would take me to the site map.  The same holds true for mydomain.com/pages/pages/pages/pages/pages/pricing.  So to answer your question, no it does not take you to the correct page, but it doesn't give you a 404 error either.  It takes you to the site map.

          1 Reply Last reply Reply Quote 0
          • kchandler
            kchandler last edited by

            The same thing is happening for one of my campaigns, specifically for a 302 redirect to the homepage. My guess is I need to update it to a 301, but I'm not 100% sure if that would solve the issue?

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • If I'm using a compressed sitemap (sitemap.xml.gz) that's the URL that gets submitted to webmaster tools, correct?
              ThompsonPaul
              ThompsonPaul
              0
              6
              1.8k

            • Strange URL's for client's site
              everestagency
              everestagency
              0
              3
              456

            • I'm redesigning a website which will have a new URL format. What's the best way to redirect all the old URLs to the new ones? Is there an automated, fast way to do this?
              GregFindley.co.uk
              GregFindley.co.uk
              0
              2
              303

            • Will a "blog=example "parameter at the end of my URLs affect google's crawling them?
              Intridea
              Intridea
              0
              3
              428

            • Are URL's with trailing slash seen as two different URLs
              seoug_2005
              seoug_2005
              0
              3
              805

            • Url's don't want to show up in google. Please help?
              RyanKent
              RyanKent
              0
              5
              587

            • Why is this url showing as "not crawled" on opensiteexplorer, but still showing up in Google's index?
              KeriMorgret
              KeriMorgret
              0
              2
              617

            • Switching ecommerce CMS's - Best Way to write URL 301's and sub pages?
              tylerfraser
              tylerfraser
              0
              7
              1.2k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy