The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawl Tool Producing Random URL's

    Crawl Tool Producing Random URL's

    Technical SEO Issues
    4 3 692
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • MyNet
      MyNet last edited by

      For some reason SEOmoz's crawl tool is returning duplicate content URL's that don't exist on my website.  It is returning pages like "mydomain.com/pages/pages/pages/pages/pages/pricing"  Nothing like that exists as a URL on my website.  Has anyone experienced something similar to this, know what's causing it, or know how I can fix it?

      1 Reply Last reply Reply Quote 0
      • Seaward-Group
        Seaward-Group last edited by

        I had this weird issue too but it was down to how our developers created the website. Does "mydomain.com/pages/pages/pages/pages/pages/pricing" still take you to the correct page or does it show you a 404 error?

        MyNet 1 Reply Last reply Reply Quote 0
        • MyNet
          MyNet @Seaward-Group last edited by

          Well we have our website setup to where if you type something after mydomain.com/ that is not a valid URL it will take you to the site map.  For example if I typed in mydomain.com/ljlksdfsdfkjsdlfjsflj it would take me to the site map.  The same holds true for mydomain.com/pages/pages/pages/pages/pages/pricing.  So to answer your question, no it does not take you to the correct page, but it doesn't give you a 404 error either.  It takes you to the site map.

          1 Reply Last reply Reply Quote 0
          • kchandler
            kchandler last edited by

            The same thing is happening for one of my campaigns, specifically for a 302 redirect to the homepage. My guess is I need to update it to a 301, but I'm not 100% sure if that would solve the issue?

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • If I'm using a compressed sitemap (sitemap.xml.gz) that's the URL that gets submitted to webmaster tools, correct?
              ThompsonPaul
              ThompsonPaul
              0
              6
              1.8k

            • How to use Google search console's 'Name change' tool?
              cmscss
              cmscss
              0
              4
              67

            • Strange URL's for client's site
              everestagency
              everestagency
              0
              3
              456

            • We have designed a new site and are in dilemna whether or not to change the site's URL structure or maybe few odd looking urls. How exactly do we go about the URL thing in toto? thanks in advance, any suggestion(s) would be dearly welcome
              ShaunPhilips
              ShaunPhilips
              1
              7
              109

            • I'm redesigning a website which will have a new URL format. What's the best way to redirect all the old URLs to the new ones? Is there an automated, fast way to do this?
              GregFindley.co.uk
              GregFindley.co.uk
              0
              2
              303

            • SEOMoz is indicating I have 40 pages with duplicate content, yet it doesn't list the URL's of the pages???
              RobertFisher
              RobertFisher
              0
              2
              391

            • Will a "blog=example "parameter at the end of my URLs affect google's crawling them?
              Intridea
              Intridea
              0
              3
              428

            • Why is this url showing as "not crawled" on opensiteexplorer, but still showing up in Google's index?
              KeriMorgret
              KeriMorgret
              0
              2
              617

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy