The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Lots of overdynamic URL and crawl errors..

    Lots of overdynamic URL and crawl errors..

    Technical SEO Issues
    2 2 523
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • filarinskis
      filarinskis last edited by

      Just wanted some advice. SEOmoz crawl found out about 18,000 errors.

      The error URLs are all mainly URLs like the one below, which seem to be the registration URL with a re-direct on, going back the product after registration:

      http://www.DOMAIN.com/index.php?_g=co&_a=reg&redir=/index.php?_a=viewProd%26productId=3465

      We have the following line in the robots file to stop the login page from being crawled:

      Disallow: /index.php?act=login

      If I add the following, will it stop the error?

      Disallow: /index.php?act=reg

      Thanks in advance**.**

      1 Reply Last reply Reply Quote 0
      • HiveDigitalInc
        HiveDigitalInc last edited by

        You should look into using using Robots.txt to filter out specific querystring parameters

        You can use asterisks (*) to match the URL type above...

        Disallow: /index.php?a=reg

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Submitted URL has crawl issue - Submitted URL seems to be a Soft 404 - but all looks fine
          JohnSammon
          JohnSammon
          0
          2
          56

        • Website crawl error
          WeAreDigital_BE
          WeAreDigital_BE
          0
          5
          94

        • Increase in Crawl Errors
          abisti2
          abisti2
          0
          5
          80

        • Help! How to Remove Error Code 901: DNS Errors (But to a URL that doesn't exist!)
          FullSteamBusiness
          FullSteamBusiness
          0
          4
          696

        • Has Google Stopped Listing URLs with Crawl Errors in Webmaster Tools?
          SEOAndy
          SEOAndy
          0
          2
          129

        • Crawl reveals hundreds of urls with multiple urls in the url string
          irvingw
          irvingw
          0
          5
          455

        • Crawl Errors
          azguy
          azguy
          0
          4
          697

        • Tracking a Crawl error
          wedmonds
          wedmonds
          0
          3
          596

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy