The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Crawl Budget vs Canonical

    Crawl Budget vs Canonical

    Web Design
    4 4 2.1k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Highland
      Highland last edited by

      Got a debate raging here and I figured I'd ask for opinions. We have our websites structured as

      site/category/product

      This is fine for URL keywords, etc. We also use this for breadcrumbs. The problem is that we have multiple categories into which a category fits. So "product" could also be at

      site/cat1/product
      site/cat2/product
      site/cat3/product

      Obviously this produces duplicate content. There's no reason why it couldn't live under 1 URL  but it would take some time and effort to do so (time we don't necessarily have). As such, we're applying the canonical band-aid and calling it good. My problem is that I think this will still kill our crawl budget (this is not an insignificant number of pages we're talking about). In some cases the duplicate pages are bloating a site by 500%.

      So what say you all? Do we just simply do canonical and call it good or do we need to take into account the crawl budget and actually remove the duplicate pages. Or am I totally off base and canonical solves the crawl budget issue as well?

      1 Reply Last reply Reply Quote 0
      • caseyhen
        caseyhen last edited by

        Hi Highland,

        I would defiantly work on making sure that your product only lives in one category.  The canonical tag is a nice little band-aid but it still fix the root of the problem.  I would suggest you can have it listed in many different categories but it only lives in one category at the product level.  So for instance:

        It's displayed here

        site/cat1
        site/cat2
        site/cat3

        But it only displays product details at a url like this

        site/category/product

        I'm not a huge fan of having Google crawl 4 or 5 extra pages per product just to find a canonical tag when you could just spend the extra programming time to make it work correctly.

        Casey

        1 Reply Last reply Reply Quote 2
        • elephantseo
          elephantseo last edited by

          Another great way to go is to not put the category in the product URL. That was usually the best solution when I work on e-commerce sites.

          trentc 1 Reply Last reply Reply Quote 1
          • trentc
            trentc @elephantseo last edited by

            agreed! we ran into the same problem with content (articles, etc). if you think of it in the same way as blog posts, they each have a unique URL, but with tags (i.e. categories) you are able to get them posted to the appropriate category landing pages.

            have a somewhat related issue that i posted here

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Website not crawling
              RuthBurrReedy
              RuthBurrReedy
              0
              2
              45

            • Drupal vs. Wordpress
              sontungaptech
              sontungaptech
              0
              8
              599

            • Post vs Pages
              CleverPhD
              CleverPhD
              1
              6
              107

            • Ajax content not crawled
              fundsindia
              fundsindia
              0
              3
              225

            • CSS vs Javascript vs JQuery drop down navigation
              WilliamCarr
              WilliamCarr
              0
              7
              4.5k

            • I've set up my own site which is still fairly new but I'm a bit concerned that there is a bloackage SEO wise somewhere because when I try to crawl the site on SEOmoz it only crawls one page.
              JoshED
              JoshED
              0
              7
              219

            • Correct Canonical Reference
              Dr-Pete
              Dr-Pete
              0
              8
              615

            • Canonical url with pagination
              Worship_Digital
              Worship_Digital
              0
              10
              10.8k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy