The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Conversion Rate Optimization
    4. Issue with a particular command of robots.txt! Help needed!

    Issue with a particular command of robots.txt! Help needed!

    Conversion Rate Optimization
    2 2 63
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • OptimizedGroup
      OptimizedGroup last edited by

      Hi all,I'm facing a strange issue with a website: www.foodmood.itI've written this robots.txt: www.foodmood.it/robots.txt in which I'm using all commands I've tested and used on other websites.The problem is that this website is not indexing correctly, and my fear is that I've written the robots in a wrong way.In this forum I've been taught that this command Disallow: /*? should be substituted with Disallow: /? in order to be sure the crawler is not indexing all the URLs containing a question mark.My question is: do you think this command modified in the above way can cause a problem to my website?I repeat that I've used it on several sites and this is the first time I'm having this kind of problems.Thanks in advance for your help.A.

      1 Reply Last reply Reply Quote 0
      • GPainter
        GPainter last edited by

        I would in future tend to trust sources closer to being official rather than someone on a forum. Remove the extra * so its just Disallow: /*?

        You can find more info here - https://support.google.com/webmasters/answer/156449

        You can also test your robots in your webmaster tools so don't forget to give that a go if in doubt.

        Hope that helps.

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • HELP: Analysing data to make decisions, SEO vs PPC
          edward-may
          edward-may
          0
          7
          316

        • Help! Tracking Conversion Source of Specific Users: Possible? How?
          MarkHawaii
          MarkHawaii
          3
          16
          1.5k

        • Help Me Improve this Page, Please
          JesusD
          JesusD
          1
          7
          161

        • Help with ranking keyword [Example inside]
          KaneJamison
          KaneJamison
          0
          3
          189

        • UX Design: Do Directional Cues Help?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          579

        • I am trying to make my site a better user experience please help
          xoffie
          xoffie
          0
          8
          435

        • Need help Tracking PPC vs Organic and respective ROI
          StreamlineMetrics
          StreamlineMetrics
          0
          3
          2.2k

        • TestFreaks.com Opinions Needed
          0
          1
          680

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy