The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Robots.txt Blocked Most Site URLs Because of Canonical

    Robots.txt Blocked Most Site URLs Because of Canonical

    Intermediate & Advanced SEO
    1 1 117
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • s_EOgi_Bear
      s_EOgi_Bear last edited by

      Had a bit of a "Gotcha" in Magento.

      We had Yoast Canonical Links extension which worked well , but then we installed Mageworx SEO Suite.. which broke Canonical Links.

      Unfortunately it started putting www.mysite.com/catalog/product/view/id/516/   as the Canonical Link -  and all URLs with /catalog/productview/*  is blocked in Robots.txt

      So unfortunately We told Google that the correct page is also a blocked page. they haven't been removed as far as I can see but traffic has certainly dropped.

      We have also , at the same time had some Site changes grouping some pages & having 301 redirects.

      Resubmitted site map & did a fetch as google.

      Any other ideas?  And Idea how long it will take to become unblocked?

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      • Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
        Martijn_Scheijbeler
        Martijn_Scheijbeler
        0
        11
        1.6k

      • If Robots.txt have blocked an Image (Image URL) but the other page which can be indexed has this image, how is the image treated?
        alphonseha
        alphonseha
        1
        4
        1.4k

      • How to make Google index your site? (Blocked with robots.txt for a long time)
        SanjidaKazi
        SanjidaKazi
        0
        3
        128

      • Blocking out specific URLs with robots.txt
        Modi
        Modi
        0
        3
        133

      • Google showing high volume of URLs blocked by robots.txt in in index-should we be concerned?
        TakeshiYoung
        TakeshiYoung
        0
        4
        302

      • Google: How to See URLs Blocked by Robots?
        ThompsonPaul
        ThompsonPaul
        0
        7
        6.0k

      • Block all but one URL in a directory using robots.txt?
        Cyrus-Shepard
        Cyrus-Shepard
        0
        3
        3.5k

      • Search Engine Blocked by robots.txt for Dynamic URLs
        KeriMorgret
        KeriMorgret
        0
        2
        689

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      • Digital Marketers
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy