The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Site Maps / Robots.txt etc

    Site Maps / Robots.txt etc

    On-Page / Site Optimization
    3 2 120
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • LockCity
      LockCity last edited by

      Hi everyone

      I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/

      Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both?

      Many thanks, Abi

      1 Reply Last reply Reply Quote 0
      • irvingw
        irvingw last edited by

        A sitemap is for crawling your pages, either a user sitemap like you set up or a sitemap.xml file which is a streamlined way for Google to spider your site.

        Robots.txt is used to direct the bots where NOT to go like if you don't want them crawling certain parts of your site like cgi-bin, js folder or images folder for example.

        LockCity 1 Reply Last reply Reply Quote 1
        • LockCity
          LockCity @irvingw last edited by

          Ahh I see thanks so much for your reply - is it best to get an XML site map rather than the one I have?

          Thanks, Abi

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • News site and duplicate/cannibalism/old
            Colemckeon
            Colemckeon
            0
            2
            35

          • What is the best way to block http://www.site.com/members/...
            Taiger
            Taiger
            0
            3
            136

          • I have more pages in my site map being blocked by the robot file than I have being allowed to be crawled. Is Google going to hate me for this?
            SVmedia
            SVmedia
            0
            3
            103

          • How do i block an entire category/directory with robots.txt?
            bricerhodes
            bricerhodes
            0
            3
            2.7k

          • Redirecting web site URL to http://torontoairportlimoflatrate.com/ to http://www.torontoairportlimoflatrate.com
            My-Favourite-Holiday-Cottages
            My-Favourite-Holiday-Cottages
            0
            2
            419

          • Duplicate content http:// something .com and http:// something .com/
            BlueprintMarketing
            BlueprintMarketing
            0
            6
            771

          • Google Page Rank of my site has dropped from 4/10 to 3/10
            SteveOllington
            SteveOllington
            1
            10
            2.8k

          • Photogallery and Robots.txt
            Rapturecamps
            Rapturecamps
            0
            5
            831

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy