The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Search pages showing up as soft 404 in WMT

    Search pages showing up as soft 404 in WMT

    Technical SEO Issues
    4 2 169
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • nomad-202323
      nomad-202323 last edited by

      Hi ....we are getting allot of "site search" pages showing up in wmt as soft 404's and wanted to know what the best would be to stop this. All search pages are already noindex follow but maybe we should block them in robots txt as well.

      Would the below help to solve this ?

      User-agent: *
      Disallow: /?s=
      Disallow: /search/

      Any other suggestions or direction would be appreciated to prevent these pages showing up as soft 404's

      tks

      1 Reply Last reply Reply Quote 0
      • Martijn_Scheijbeler
        Martijn_Scheijbeler last edited by

        Hi,

        I would recommend making sure that you block these kind of pages in your robots.txt as well in order to make sure that the bots aren't wasting their crawl budget on these kind of pages. What we included for this were the lines:

        Disallow: ?s=
        Disallow: /search/*

        nomad-202323 2 Replies Last reply Reply Quote 1
        • nomad-202323
          nomad-202323 @Martijn_Scheijbeler last edited by

          thanks Martijn appreciate it.....any suggestion to get the "empty" search pages to 404 and not 200 if urls are entered directly?

          1 Reply Last reply Reply Quote 0
          • nomad-202323
            nomad-202323 @Martijn_Scheijbeler last edited by

            Hi Martijn.....I have blocked in robots.txt as you have suggested and have fetched as google bot on the soft 404.s and they are blocked. Can i go ahead and mark these as fixed or are they really only fixed if these pages return 404? I am not sure how i can return 404 on them though as they are legit search result pages.

            I really just want to know the best way to deal with them in wmt now that i have blocked them in robots.

            thank you

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Can a page that's 301 redirected get indexed / show in search results?
              Colemckeon
              Colemckeon
              0
              3
              43

            • Hybrid page showing in Google search results
              MattRoney
              MattRoney
              0
              5
              91

            • I am using All-in-One-seo. I change the title and meta description on the home page, but it is not showing up on the search. It is on the source code. When I change other pages, the both show up in the search, just not the home page. Any idea why?.
              jgodwin
              jgodwin
              0
              11
              3.2k

            • My 404 page is returning a 404
              CleverPhD
              CleverPhD
              0
              7
              114

            • Google showing https:// page in search results but directing to http:// page
              JaneCopland
              JaneCopland
              0
              4
              218

            • 404's in WMT are old pages and referrer links no longer linking to them.
              sprynewmedia
              sprynewmedia
              0
              3
              597

            • My 404 page shows in the report as an error.
              Andropenis_Australia
              Andropenis_Australia
              0
              2
              169

            • Disallow: /search/ in robots but soft 404s are still showing in GWT and Google search?
              timhatton
              timhatton
              0
              7
              374

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy