The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Robots.txt Blocked Most Site URLs Because of Canonical

    Robots.txt Blocked Most Site URLs Because of Canonical

    Intermediate & Advanced SEO
    1 1 117
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • s_EOgi_Bear
      s_EOgi_Bear last edited by

      Had a bit of a "Gotcha" in Magento.

      We had Yoast Canonical Links extension which worked well , but then we installed Mageworx SEO Suite.. which broke Canonical Links.

      Unfortunately it started putting www.mysite.com/catalog/product/view/id/516/   as the Canonical Link -  and all URLs with /catalog/productview/*  is blocked in Robots.txt

      So unfortunately We told Google that the correct page is also a blocked page. they haven't been removed as far as I can see but traffic has certainly dropped.

      We have also , at the same time had some Site changes grouping some pages & having 301 redirects.

      Resubmitted site map & did a fetch as google.

      Any other ideas?  And Idea how long it will take to become unblocked?

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      • If I block a URL via the robots.txt - how long will it take for Google to stop indexing that URL?
        GastonRiera
        GastonRiera
        0
        3
        98

      • Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
        Martijn_Scheijbeler
        Martijn_Scheijbeler
        0
        11
        1.6k

      • What do you add to your robots.txt on your ecommerce sites?
        Deacyde
        Deacyde
        0
        3
        3.0k

      • Robots.txt - Do I block Bots from crawling the non-www version if I use www.site.com ?
        PatrickDelehanty
        PatrickDelehanty
        0
        2
        479

      • Use Canonical or Robots.txt for Map View URL without Backlink Potential
        ahmettanir
        ahmettanir
        0
        5
        118

      • Block in robots.txt instead of using canonical?
        RobertFisher
        RobertFisher
        0
        9
        1.6k

      • What should I block with a robots.txt file?
        Travis-W
        Travis-W
        1
        3
        298

      • Block all but one URL in a directory using robots.txt?
        Cyrus-Shepard
        Cyrus-Shepard
        0
        3
        3.5k

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      • Digital Marketers
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy