The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Paid Search Marketing
    4. Google Shopping Feed being blocked by robots.txt

    Google Shopping Feed being blocked by robots.txt

    Paid Search Marketing
    3 2 724
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • sparrowdog
      sparrowdog last edited by

      I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.

      I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.

      Does anyone know how long it will take for Google to see it again?

      1 Reply Last reply Reply Quote 0
      • FedeEinhorn
        FedeEinhorn last edited by

        Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.

        sparrowdog 1 Reply Last reply Reply Quote 1
        • sparrowdog
          sparrowdog @FedeEinhorn last edited by

          When I manually fetch, the /images folder isn't on the list anymore.

          For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.

          Thanks for your help.

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Can Google Shopping Ads Lower Ranking due to Bounce?
            TrentonGreener
            TrentonGreener
            1
            7
            678

          • 301 Redirects and Google Shopping Feeds
            DmitriiK
            DmitriiK
            0
            5
            670

          • How to deal with the InCorrect Price Issue for the Google Shopping Product Listing Ads?
            troy.evans
            troy.evans
            0
            2
            357

          • How I can saw Handling Price for Google Shopping Feed
            Alick300
            Alick300
            0
            2
            136

          • Do only paid adwords appear in google shopping
            MonicaOConnor
            MonicaOConnor
            0
            6
            275

          • Hire Products on Google Shopping
            ese
            ese
            0
            5
            742

          • Blocking google adwords on google.com?
            kayintveen_MD
            kayintveen_MD
            0
            5
            2.0k

          • Recommend a company for Google Product Feed?
            ChristopherGlaeser
            ChristopherGlaeser
            0
            2
            121

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy