The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How can I exclude display ads from robots.txt?

    How can I exclude display ads from robots.txt?

    Technical SEO Issues
    2 2 504
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • GregBeddor
      GregBeddor last edited by

      Google has stated that you can do this to get spiders to content only, and faster. Our IT guy is saying it's impossible.
      Do you know how to exlude display ads from robots.txt?

      Any help would be much appreciated.

      1 Reply Last reply Reply Quote 0
      • EricaMcGillivray
        EricaMcGillivray last edited by

        You'd want to make the URL paths where the display ads live to have the crawl disallowed in your robots.txt, just like any other section of your site. Here's some basics on robots.txt.

        Hope this helps!

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Adding your sitemap to robots.txt
          Martijn_Scheijbeler
          Martijn_Scheijbeler
          0
          3
          2.9k

        • How can I make it so that robots.txt is not ignored due to a URL re-direct?
          rodelmo4
          rodelmo4
          0
          4
          56

        • Can I Block https URLs using Host directive in robots.txt?
          LoganRay
          LoganRay
          0
          4
          760

        • Is there a limit to how many URLs you can put in a robots.txt file?
          CraigBradford
          CraigBradford
          0
          10
          1.1k

        • Can I rely on just robots.txt
          ThompsonPaul
          ThompsonPaul
          0
          6
          194

        • What can I do if Google Webmaster Tools doesn't recognize the robots.txt file?
          wrttnwrd
          wrttnwrd
          0
          7
          396

        • Can I Disallow Faceted Nav URLs - Robots.txt
          AlanMosley
          AlanMosley
          0
          5
          914

        • Robots.txt and robots meta
          TheEspresseo
          TheEspresseo
          0
          5
          1.1k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy