The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Fetch as Google -- Does not result in pages getting indexed

    Fetch as Google -- Does not result in pages getting indexed

    Intermediate & Advanced SEO
    1 1 82
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jplehmann
      jplehmann last edited by

      I run a exotic pet website which currently has several types of species of reptiles. It has done well in SERP for the first couple of types of reptiles, but I am continuing to add new species and for each of these comes the task of getting ranked and I need to figure out the best process.

      We just released our 4th species, "reticulated pythons", about 2 weeks ago, and I made these pages public and in Webmaster tools did a "Fetch as Google" and index page and child pages for this page: http://www.morphmarket.com/c/reptiles/pythons/reticulated-pythons/index

      While Google immediately indexed the index page, it did not really index the couple of dozen pages linked from this page despite me checking the option to crawl child pages.  I know this by two ways: first, in Google Webmaster Tools, if I look at Search Analytics and Pages filtered by "retic", there are only 2 listed. This at least tells me it's not showing these pages to users.  More directly though, if I look at Google search for "site:morphmarket.com/c/reptiles/pythons/reticulated-pythons" there are only 7 pages indexed.

      More details -- I've tested at least one of these URLs with the robot checker and they are not blocked.  The canonical values look right. I have not monkeyed really with Crawl URL Parameters. I do NOT have these pages listed in my sitemap, but in my experience Google didn't care a lot about that -- I previously had about 100 pages there and google didn't index some of them for more than 1 year.  Google has indexed "105k" pages from my site so it is very happy to do so, apparently just not the ones I want (this large value is due to permutations of search parameters, something I think I've since improved with canonical, robots, etc).  I may have some nofollow links to the same URLs but NOT on this page, so assuming nofollow has only local effects, this shouldn't matter.

      Any advice on what could be going wrong here.  I really want Google to index the top couple of links on this page (home, index, stores, calculator) as well as the couple dozen gene/tag links below.

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      • How do internal search results get indexed by Google?
        willcritchlow
        willcritchlow
        0
        8
        991

      • How to get a large number of urls out of Google's Index when there are no pages to noindex tag?
        effectdigital
        effectdigital
        0
        2
        50

      • Best way to link to 1000 city landing pages from index page in a way that google follows/crawls these links (without building country pages)?
        lcourse
        lcourse
        0
        7
        54

      • Should I worry about rendering problems of my pages in google search console fetch as google?
        NickLeRoy
        NickLeRoy
        0
        2
        92

      • When does Google index a fetched page?
        friendoffood
        friendoffood
        0
        18
        272

      • "No index" page still shows in search results and paginated pages shows page 2 in results
        khi5
        khi5
        0
        3
        114

      • Incorrect cached page indexing in Google while correct page indexes intermittently
        MikeRoberts
        MikeRoberts
        0
        2
        298

      • How long does google take to show the results in SERP once the pages are indexed ?
        Devanur-Rafi
        Devanur-Rafi
        0
        11
        4.5k

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      • Digital Marketers
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy