The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Moz Crawl Test: WordPress sites with and without /feed and /trackback entires?

    Moz Crawl Test: WordPress sites with and without /feed and /trackback entires?

    Moz Tools
    8 4 394
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Titan552
      Titan552 last edited by

      I have multiple WP websites and on some of the websites, on my Moz Crawl test,  I see an entry for every blog post but also entries for /feed and /trackback for that single blog post.  For example,

      www...com/someArticle

      www....com/someArticle/feed

      www...com/someArticle/trackback

      1. Can anyone explain why the Crawl test is picking up the /feed and /trackback items?  Is it simply because they are 301 redirects to the original post (www...com/someArticle)?

      2. What setting(s) in WordPress are making this information appear?  Or is it just that the site(s) that have the /feed and /trackback are displaying "normal" behavior for a WP site with a lot of trackbacks and feed entires?

      3. Should /fee and /trackback, as well as /author be blocked in robots.txt?

      Thanks in advance for your advice and input!

      1 Reply Last reply Reply Quote 0
      • BlueprintMarketing
        BlueprintMarketing last edited by

        the TrackBacks are from people posting either identical or similar content to WordPress.com I would follow up with that.  unless that person is you.

        No do not block a feed with robots.txt and do not block the TrackBacks use automatics Digital millennium act takedown if somebody is stealing your content.

        Sincerely,

        Thomas

        Titan552 1 Reply Last reply Reply Quote 0
        • Titan552
          Titan552 @BlueprintMarketing last edited by

          Thank you.

          When you say "TrackBacks are from people posting either identical or similar content to WordPress.com", what do you mean?  I thought trackbacks were notifications of links back when someone links to your content?

          And why does the codex recommend blocking feeds and trackbacks in robots.txt?

          Thanks again!

          BlueprintMarketing 1 Reply Last reply Reply Quote 0
          • BlueprintMarketing
            BlueprintMarketing @Titan552 last edited by

            Hi, you should never block feeds they're really pretty beneficial to your site. Take a look at this from Joost it will explain it much better than I can

            http://yoast.com/example-robots-txt-wordpress/

            All the best sincerely, Thomas

            Titan552 1 Reply Last reply Reply Quote 0
            • Titan552
              Titan552 @BlueprintMarketing last edited by

              Thanks, I'll check it out!

              1 Reply Last reply Reply Quote 0
              • evolvingSEO
                evolvingSEO last edited by

                1. If you check the source code of your blog posts, there must be some sort of link to the feeds - possibly even in the header. I'm not 100% on how the Moz crawler operates (if it only spiders <a>anchor links or if it spiders referenced links in the header - pretty sure the latter) - but either way that's how they're finding it, through some sort of link on the page.</a>

                <a>You could try running a crawl with Screaming Frog SEO Spider and see if it also picks up the feed URLs and Screaming Frog will show you where it found the links as well.

                2. Good question. Your theme may be displaying links to these things somewhere - the best way to find out is to crawl with Screaming Frog and it will show you which pages link to your feed  and trackback URLs. Then if you don't need them, you can go into the editor and remove them from the code.

                3. I agree with Thomas here, I would not block them with robots.txt - rather I would see if you can fix them at the source and remove the links if they are not needed.

                -Dan</a>

                1 Reply Last reply Reply Quote 1
                • Titan552
                  Titan552 last edited by

                  So I solved the problem (or at least figured where it was coming from).  On this particular site, under the comments area, there is a link for "trackback url" and a link for "comments rss feed".  Naturally these are ../trackback and ../blog so that's why the crawl is picking them up.  They are 301 redirected to the "parent" page so that's why they are not a duplicate content issue.  Thank to everyone for their help!

                  1 Reply Last reply Reply Quote 0
                  • jampaper
                    jampaper last edited by

                    I have the same issue but instead of it redirecting to the parent post its just going to a 404 page.

                    1 Reply Last reply Reply Quote 0
                    • 1 / 1
                    • First post
                      Last post
                    • How do I combat title tag issues in Moz because of long company/site name? [Currently using Yoast SEO Plugin]
                      4RS_John
                      4RS_John
                      0
                      15
                      770

                    • Is it possible to block Moz from crawling sites?
                      co.mc
                      co.mc
                      0
                      4
                      239

                    • How do a run a MOZ crawl of my site before waiting for the scheduled weekly crawl?
                      Kingalan1
                      Kingalan1
                      0
                      6
                      654

                    • Does Open Site Explorer purposefully not crawl some sites?
                      KeriMorgret
                      KeriMorgret
                      0
                      4
                      281

                    • Settings to crawl entire site
                      KeriMorgret
                      KeriMorgret
                      0
                      2
                      415

                    • I have corrected the Problems in Crawl Diagnostics. When would it refresh/ re-crawl my site ?
                      VarunBansal
                      VarunBansal
                      0
                      3
                      475

                    • How to handle crawl diagnostic errors for the same url. /products & /products/
                      Keszi
                      Keszi
                      0
                      2
                      678

                    • The Site Explorer crawl shows errors for files/folders that do not exist.
                      randfish
                      randfish
                      0
                      3
                      1.5k

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    • Digital Marketers
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy